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FORETfORD 


The  Third  Annual  Statistical  Engineering  Symposium 
was  sponsored  on  2-3  May  1957  by  the  U.  S.  Army  Chemical 
Corps  Engineering  Command  to  continue  the  advancement  of 
knowledge  in  the  rapidly  expanding  field  of  "Statistical 
Engineering".  Over  a period  of  throe  years,  thirty-five 
significant  applications  of  statistical  techniques  to 
engineering  problems  have  been  presented  and  discussed 
by  engineers,  statisticians  and  technical  administrators 
representing  virtually  every  type  of  technical  ostablisliment . 

The  nine  papers  included  in  this  volume  are 
illustrative  of  the  many  typos  of  engineering  problems 
that  have  been  resolved  through  the  use  of  statistical 
techniques.  It  is  equally  interesting  to  note  the 
different  statistical  techniques  used  by  the  authors  of 
each  paper  in  approaching  their  respective  problems. 

Readers  of  these  proceedings  are  invited  to  submit 
their  comments  on  the  program  and  the  administration 
of  the  symposium.  The  sponsor  also  -vould  welcome  the 
submission  of  papers  for  presentation  at  future  sjnnposia 
of  this  type. 

No  reproduction  of  the  papers  contained  herein  is 
authorized  in  v/hole  or  in  part,  without  the  permission 
of  the  authors . 
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EXPERIMENTS  WITH  MANY  FACTORS 


By  Marvin  Zelen 
National  Bureau  of  Standards 


Among  the  most  difficult  types  of  experiments  to  con- 
duct is  the  experiment  to  investigate  the  joint  effects  of 
several  factors  on  the  performance  of  a piece  of  equipment, 
or  the  yield  of  a product,  or  the  characteristics  of  a 
test  method.  A considerable  advantage  is  gained  if  the 
experiment  is  conducted  so  that  the  effects  of  changing 
each  variable  can  be  evaluated  jointly  with  the  effects 
of  changing  the  other  variables  which  might  conceivably 
affect  the  outcome  of  the  experiment.  One  way  of  achieving 
this  objective  is  to  decide  on  a set  of  conditions  for 
each  factor  and  to  carry  out  one  or  more  measurements  for 
every  possible  combination  of  the  conditions.  Such  experi- 
ments are  termed  factorial  experiments  or  multi-factor 
experiments . 

Other  things  being  equal,  the  smaller  the  number  of 
factors,  the  fewer  the  difficulties  encountered.  However, 
because  of  possible  complex  inter-dependencies  among  the 
various  factors,  the  difficulties  associated  with  factorial 
experiments  become  formidable  for  even  a moderate  number 
of  factors. 

The  first  application  of  the  formal  theory  of  factorial 
experimentation  was  devised  to  fit  the  special  problems  of 
agricultural  research.  Here,  the  agricultural  scientist 
planted  in  the  spring,  harvested  in  the  fall  and  used  the 
entire  winter  for  analyzing  the  results.  Somewhat  later, 
efforts  were  made  to  adapt  these  experimental  procedures 
for  use  in  the  physical  and  engineering  sciences.  The 
recent  growth  of  the  subject  of  the  statistical  design  of 
experiments  has  occurred  in  response  to  the  need  for  methods 
specially  suited  to  these  new  areas  of  applications. 

Among  the  difficulties  encountered  with  the  application 
of  factorial  experiments  in  the  physical  ?.nd  engineering 
sciences  Is  that  the  total  number  of  different  combinations 
of  conditions  may  be  quite  large  and  in  many  cases  pro- 
hibitive. Another  disadvantage  is  that  in  many  experimental 
situations  it  is  not  practical  to  plan  an  entire  experi- 
mental program  in  advance,  but  Instead,  to  make  a few 


smaller  experiments  which  serve  as  a guide  to  further  work. 
This  latter  condition  is  especially  true  when  measurements 
are  made  singly  or  in  small  groups,  such  that  the  experi- 
mental results  become  known  sequentially  as  they  are  taken. 

In  response  to  these  disadvantages  ways  of  conducting 
factorial  experiments  have  been  developed  which  require  a 
smaller  number  of  measurements  selected  from  all  possible 
combinations.  These  reduced  factorial  experiment  plans 
are  called  fractional  factorial  experiment  plans  or 
fractional  replicates.  The  key  idea  behind  fractional 
replication  is  to  choose  a sub-set  from  all  possible  com- 
binations such  that  the  sub-set  chosen  (i)  contains  more 
relevant  information  than  any  other  sub-set  and  (ii)  the 
analysis  is  easy  and  straight-forward. 

Recently  a publication  entitled  "Fractional  Factorial 
Designs  for  Factors  at  Two  Levels",  authored  by  members 
of  the  Statistical  Engineering  Laboratory  of  the  National 
Bureau  of  Standards,  appeared  in  print.  This  publication 
is  a catalogue  of  fractional  factorial  experiment  plans 
covering  a wide  range  of  experimental  situations.  The 
fractional  plans  in  this  catalogue  are  for  situations 
covering  from  5 through  l6  factors  and  enable  fractions  of 
1/2,  1/5,  1/8,  ...,  1/256  of  a full  experiment  to  be 
chosen.  It  is  the  purpose  of  my  talk  today  to  discuss 
fractional  experimentation  and  to  describe  these  fractional 
factorial  plans.  However,  before  describing  fractional 
experimentation,  I would  like  to  discuss  some  of  the  basic 
concepts  involved  in  complete  factorial  experimentation. 

An  example  of  a simple  factorial  experiment  is  provided 
by  an  experiment  recently  conducted  at  the  National  Bureau 
of  Standards.  This  experiment  was  concerned  with  evaluating 
the  strength  of  steel  with  respect  to 

A:  Carbon  Content 

B:  Tempering  Temperature 

C:  Method  of  Cooling. 

Part  of  this  experiment  consisted  of  considering  two 
different  conditions  for  each  of  the  three  factors.  It 
will  be  convenient  to  designate  these  three  factors  by  the 
letters  A,  B,  and  C,  respectively.  Also  we  shall  denote 
one  of  the  particular  conditions  at  which  a factor  is 
evaluated  by  the  sub-script  0 and  the  other  by  a sub-script  1 . 
For  example  the  two  tempering  temperatures  involved  were 
400°F  and  6OO  r.  These  are  represented  by  the  symbols 


r 


♦ 


Bq  and  B-,  respectively.  Statisticians  refer  to  the 
different  experimental  conditions  of  a factor  by  the  term 
level.  Thus  each  of  the  factors  in  this  experiment  has  2 
levels,  and  the  experiment  is  termed  a 2^  factorial  experi- 
ment. Often  we  term  the  level  with  the  0 sub-script  as 
a "low-level”  and  the  level  with  the  1 sub-script  as  the 
"high-level"  of  a factor.  Table  1 contains  the  experi- 
mental results  for  the  8 possible  factorial  combinations. 

Table  1.  Results  of  Experiment 


a 


B, 


A 

^0 

169 

167 

^1 

173 

165 

Cq 

145 

135 

143 

134 

A - Carbon  Content 
B a Tempering  Temperature 
C a Method  of  Cooling 

These  results  ^ (coded  for  easy  presentation)  represent 
the  strengths  of  8 steel  specimens  after  a given  period  of 
stress . 

Now  in  designating  each  of  the  8 factorial  combinations, 
it  will  be  convenient  to  use  the  notation  of  Table  2. 

Table  2.  Notation  for  Factorial  Combinations 


Combination 

Designation 

> 

0 

CD 

0 

Cq 

(1) 

^1  Bq 

Co 

a 

^0  ®1 

Co 

b 

Ai 

Co 

ab 

Bq 

Cl 

ac 

09 

0 

< 

Cl 

be 

Ai  B^ 

Cl 

abc 

^The  measurements  are  Ibs./in^  divided  by  10^ 
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Note  that  the  notation  is  such  that  if  the  level  of  a 
particular  factor  is  at  the  low  level,  the  letter  is 
missing;  if  the_ level  present  is  at  the  high  level,  the 
letter  appears.  The  combination  where  all  three  factors 
are  at  the  low  level  is  simple  designated  by  the  number 
(1). 


Strength 


i t - 5 lo 


strength 


Flgrures  la  and  lb  graph  the  results  of  the  experimental 
results  where  figure  la  refers  to  the  4 measurements  made 
at  the  Cg  condition  and  figure  lb  refers  to  the  4 measure- 
ments made  at  the  Cj  condition.  In  each  of  these  graphs, 
strength  is  plotted  against  the  carbon  content.  The  lines 
Joining  the  pairs  of  points  Join  those  points  which  have 
the  same  level  of  tempering  temperature.  That  is  the  line 
Joining  (1)  and  a in  figure  la  joins  those  two  points 
having  conditlon'^o*  Similar  interpretations  hold  for  the 
other  lines. 


4 


n 
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I 
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Now  suppose  we  wished  to  evaluate  the  change  of 
strength  resulting  from  considering  the  two  different 
carbon  contents.  Since  the  carbon  factor  is  represented 
by  A,  we  could  regard  the  effects  of  a change  in  strength 
with  respect  to  a change  in  carbon  content  to  be  re- 
flected by  the  slopes  of  the  four  lines  shown  in  figures 
la  and  lb.  If  the  slopes  are  near  zero,  then  we  would  be 
justified  in  stating  that  the  effect  of  a change  in 
carbon  content  on  strength  is  small  over  the  range  of  the 
experimental  conditions  encountered  here.  It  is  an  easy 
matter  to  calculate  the  slopes  for  each  of  the  four  lines. 
If  we  regard  the  difference  in  carbon  content  to  be  equal 
to  a unit  difference,  then  the  slope  is  equal  to  the 
difference  of  the  two  points  joined  by  each  line.  For 
example,  for  condition  Bq  Cq,  the  slope  is  equal  to 

a-(l)  = 167-169  = -2. 

We  have  four  such  slopes 


a-(l) 

= 167-169 

= -2 

ab-b 

= 155-1^5 

= -10 

ac-c 

= 165-175 

= -8 

abc-bc 

= 134-143 

* -9 

Average 

= -7.25 

Each  of  these  slopes  represents  the  change  in  strength 
with  a change  in  carbon  content,  holding  the  other  factors 
fixed.  Now  if  one  wanted  the  average  chaise  due  to  carbon 
content,  over  the  range  of  conditions  of  this  experiment, 
we  would  simply  take  the  average  of  the  four  slopes  which 
is  = -7.25.  Similar  calculations  can  be  made  for  the 
remaining  two  factors.  These  results  are  summarized  in 
Table  3.  Statisticians  usually  label  these  average  slopes 
by  the  term  main  effects 


Factor 

A 

B 

C 


Table  3. 

J (a-1)  + (ab-b) 
I (b-1)  + (ab-a) 

^ (c-1)  + (ac-a) 


Average  Slopes 
Formula 

+ (ac-c)  + (abc-bc) 
+ (bc-c)  + (abc-ac) 

+ (bc-b)  + (abc-ab) 


Value 

-7.25 


-29.25 


- .025 


i 

i 


I 
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From  Table  5 it  is  easy  to  see  that,  in  general, 
factor  B (tempering  temperature)  produced  the  most  change 
in  strength.  Factor  C produced  almost  a trivial  change  in 
strength.  No\7  suppose  we  wished  to  evaluate  the  inter- 
dependence of  factor  A on  factor  B.  That  is,  does  the 
effect  of  carbon  content  on  strength  depend  upon  the 
tempering  temperature?  One  way  of  answering  this  question 
is  for  fixed  C,  to  compare- the  two  slopes  with  respect 
to  factor  A for  condition  Bq  and  condition  Bj . In  other 
words,  looking  at  figure  la,  which  represents  the  four 
measurements  made  at  condition  Cq,  we  would  like  to 
ascertain  if  the  two  slopes  are  parallel.  If  they  are 
parallel,  this  would  indicate  that  the  change  due  to  factor 
A is  independent  of  factor  B and  factor  A is  said  to  not 
interact  with  factor  B.  A similar  comparison  can  be  made 
for  figure  lb  which  represents  the  four  measurements 
made  with  Cj^. 

The  tv/o  slopes  on  figure  la  are 

slope  for  Bq'.  a-(l)  = -2 

slope  for  Bj^ : ab-b  = -10 

difference  = 8 

For  figure  lb,  the  two  slopes  are 

> slope  at  Bq  ac-c  = -8 

slope  at  Bj^  abc-bc  = -9 

difference  = +1 

If  the  pairs  of  slopes  are  parallel,  we  would  expect  the 
differences  to  be  near  zero.  Again,  as  with  the  average 
slopes,  we  could  take  the  average  of  these  two  differences 
to  represent  the  average  interdependence  of  factor  A on 
factor  B.  This  results  is  4.5.  Similar  calculations  can 
be  made  for  AC  and  BC.  These  are  shown  in  Table  4.  When 
these  average  differences  are  divided  by  2,  statisticians  term 
the  result  a two-factor  interaction. 

Table  4.  Average  Differences  Between  Slopes 


Formula  Value 


AB 

- 

(ab-b]J  + 

Hac-c)  - 

(abc-bc  )J  j 

4.5 

AC 

(ac-c)J  + 

f(ab-b)  - 

(abc-bc )J  J 

2.5 

BC 

1 [fib-D  - 

(bc-c)J  + 

£(ab-a)  - 

(abc-ac  )J J 

2.5 

The  greatest  Intardependency  appears  to  be  that  between  the 
factors  A and  B. 

Note  that  the  formula  in  tables  3 and  4 are  made  up 
of  linear  functions  of  the  observations,  divided  in  one 
case  by  4,  and  in  the  other  case  by  2.  For  purposes  of 
comparison,  we  can  dispense  with  these  divisors.  Table  5 
brings  together  all  the  appropriate  formula  without  these 
divisors . 


Table  5-  Main  effects  and  interactions 


1 

a 

b 

ab 

c 

ac 

be 

abc 

Value 

A 

- 

+ 

+ 

- 

+ 

- 

+ 

-29.00 

B 

- 

- 

+ 

+ 

- 

- 

+ 

+ 

-117 . 00 

C 

- 

- 

- 

- 

+ 

+ 

+ 

+ 

.10 

AB 

- 

+ 

+ 

- 

- 

+ 

+ 

- 

9.0 

AC 

- 

+ 

- 

+ 

+ 

- 

+ 

- 

5.0 

BC 

- 

- 

+ 

+ 

+ 

+ 

- 

- 

5.0 

ABC 

+ 

- 

- 

+ 

- 

+ 

+ 

- 

-7.0 

A+BC 

-2 

0 

0 

+2 

0 

+2 

-2 

0 

-24.0 

B+AC 

-2 

0 

0 

+2 

0 

-2 

+2 

0 

-108.0 

C+AB 

-2 

0 

0 

-2 

0 

+2 

+2 

0 

9.1 

The  quantities  associated  with  the  single  letters  A, 

B,  and  C are  multiples  of  the  main  effect  or  average  slope. 
These  measure  the  trends  produced  by  the  various  factors. 
The  quantities  associated  with  pairs  of  letters  are  simply 


If  this  same  experiment  was  completely  run  again  and  the 
same  calculations  were  made,  we  would  expect  different 
numerical  results  than  those  presented  in  Tables  3 and  4. 

These  different  results  are  simply  due  to  the  random  errors 
inherent  in  the  experiment.  Therefore  inorder  to  objectively 
decide  whether  certain  apparent  effects  amongst  the  factors 
are  real  one  would  have  to  compare  the  numerical  results  with 
a measure  of  the  random  errors.  There  are  many  statistical 
techniques  for  carrying  out  such  comparisons.  These  are 
classified  under  the  general  title  of  "Tests  of  hypothesis "and 
are  somewhat  beyond  the  scope  of  this  paper,  cf.  Davies 
(3),  Kempthorne  (5). 
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a multiple  of  the  two  factor  interaction  or  the  average 
difference  in  slope.  These  measure  the  dependence  of  pairs 
of  factors  on  each  other.  By  an  easy  formal  generalization, 
one  can  define  a three-factor  interaction  which  is  pre- 
sented (without  the  divisor)  in  Table  5-  Also,  if  more 
factors  were  involved,  we  could  formally  define  4-factor, 
5-factor,  and  other  higher  order  interaction  terms.  In 
this  paper  we  shall  be  confining  our  attention  to  main 
effects  and  2-factor  interactions  as  the  higher  order 
interactions  do  not  appear  to  arise  often  in  applications. 

Now  suppose  we  were  in  the  situation  of  wanting  to 
select  half  of  the  8 combinations  for  experimentation. 

For  this  purpose,  let  the  four  measurements  selected  for 
the  1/2  fraction  be  those  having  a + coefficient  in  the 
ABC  interaction.  These  are 

1,  ab,  ac,  be. 

If  we  had  run  this  1/2  replicate  experiment,  aside 
from  a loss  in  precision  arising  from  taking  a smaller 
number  of  measurements,  another  penalty  involved  would  be 
that  the  estimates  of  the  main  effects  and  interactions 
become  entangled  or  "aliased"  with  one  another.  For 
example,  referring  to  Table  5»  we  can  add  the  formula 
for  the  main  effect  A to  BC.  This  gives  the  estimate  for 
A + BC  which  only  involves  the  four  measurements  used  in 
the  1/2  replicate.  This  formula  appears  in  the  bottom 
half  of  Table  5-  Usually  we  say  that  the  main  effect  A 
and  the  two-factor  interaction  BC  are  aliased  with  one 
another.  There  is  no  v/ay  of  separating  the  two  using 
those  four  measurements.  However,  if  from  a priori 
reason,  v/e  could  consider  the  BC  interaction  to  be 
zero  or  negligible,  then  we  might  interpret  A + BC  as 
reflecting  principally  the  main  effect  A.  Similar 
quantities  can  be  calculated  for  B + AC  and  C + AB 
which  appear  in  the  lower  part  of  Table  5* 

Previously  we  pointed  out  that  the  measurements 
selected  for  the  1/2  replicate  v/ere  those  which  appeared 
'vith  + coefficients  in  the  ABC  interaction.  Me  usually 
indicate  this  by  I = ABC.  This  quantity  is  called  the 
fundamental  identity.  It  can  be  used  for  selecting  the 
fractional  replicate  and  also  for  determining  the  aliases 
of  all  main  effects  and  interactions.  The  factorial 
combinations  were  simply  those  combinations  having  an 
even  number  of  letters  in  common  with  the  fundamental 
identity,  i.e.,  (l),  ab,  ac,  be. 


In  order  to  determine  the  aliases  of  any  factor, 
we  multiply  both  sides  of  the  fundamental  identity  by 
that  factor.  For  example,  for  the  main  effect  A we 
have 


A-I  = A^BC 


and  using  the  convention 

A-I  = A,  A^  = 1 

we  have  A = BC  and  state  that  A is  aliased  with  BC. 


These  principles  represent  the  basic  aspects  of 
fractional  factorial  experimentation.  For  any  particular 
fraction,  there  will  be  many  different  fractional  designs. 
The  National  Bureau  of  Standards  designs  have  been  con- 
structed on  the  premise  that  the  most  important  information 
needed  is  that  associated  with  main  effects;  the  second 
most  important  information  is  that  on  two-factor  inter- 
actions. Information  on  higher  order  interactions  is 
considered  of  negligible  importance.  The  NBS  designs 
were  so  made  up  that  all  main  effects  were  aliased  with 
3-factor  and  higher  order  interactions.  If  a two-factor 
interaction  was  aliased  only  with  3-fa-ctor  or  higher 
order  interactions,  the  interaction  was  called  a measurable 
2-factor  interaction.  It  was  attempted  to  construct  the 
designs  to  attain  the  maximum  possible  number  of 
measurable  2-factor  interactions. 


Table  6.  1/8  replication  of  8 factors  in  8 blocks  of  4 units 

each. 

Factors;  A , B,C, D, E,F,G, H, 

I - ABBGH-ACFG-BCEFH-ABCD-CDBGn-BDFG-ADEFH. 

Block  confounding:  BGH,FG,EFH,BEH,BG,BEFGH,BF. 

Row  confounding:  ABEF, ACE, BCF. 

Completely  randomized:  The  following  two-factor  interactions 
are  measurable:  AE, AH, BE, BH, CE, CH, DE,CH, EF, EG, EH,FH,GH 


Blocks  only;  The  following  two-factor  interactions  are 
measurable ; AE , AH , BE , BH , CE , CH , DE , CH , EF , EG , EH , FH , GH . 

Blocks  and  Rows;  The  following  two-factor  interactions  are 
measurable ; AE , AH , BE , BH , CE , CH , DE , CH , EF , EG , FG , GH . 


1 

(T) 

abcdefg 

abcdfgh 

eh 


2 

abed 

efg 

fgh 

abedeh 


Blocks 

3 "T  5 

acfg  bdTg  edefh 

bde  ace  abgh 
bdh  ach  abeg 
acefgh  bdefgh  cdf 


6 

aEefh 

edgh 

edeg 

adf 


7 

adegh 

befh 

beef 

abf 


8 

bcegh 

adfh 

adef 

beg 
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Table  6 shows  the  information  needed  for  carrying 
out  a 1/8  fraction  of  an  experiment  involving  8 factors 
such  that  each  factorois  at  two  levels.  The  full 
factorial  requires  2°  = 256  different  combinations.  The 
1/8  fractional  design  needs  onl.y  52  measurements.  The 
32  selected  measurements  are  given  in  8 columns.  It  can 
be  shown  that  no  other  selection  of  32  measurements  will 
give  more  relevant  information  than  this  experiment 
plan. 

The  fundamental  identity  for  this  plan  is  associated 
with  the  letter  I as  before,  however,  because  this  is  a 
1/8  replicate,  2^  -1  = 7 terms  appear  in  the  fundamental 
identity.  Thus,  every  main  effect  and  interaction  will 
be  aliased  with  7 other  interactions.  Of  the  28  possible 
two-factor  interactions,  exactly  I3  are  measurable.  The 
interpretation  of  the  remaining  15  two-factor  inter- 
actions is  questionable  as  these  contain  aliases  which 
have  two-factor  interactions. 

Often  the  measurements  or  the  experimental  material 
may  come  in  homogeneous  groups . These  homogeneous  groups 
of  measurements  are  called  blocks . For  example,  quite 
often  only  a limited  number  of  measurements  can  be  made 
in  one  day.  In  this  case,  the  measurements  made  on  a 
single  day  would  represent  a block  of  measurements.  Then 
if  measurements  made  on  a single  day  show  better  agreement 
with  each  other  than  measurements  from  different  days,  we 
would  like  to  take  this  into  account  in  our  experimental 
plan  so  as  to  avoid  or  balance  out  any  biases  arising 
from  the  day  to  day  variation.  These  fractional  plans 
have  been  constructed  so  as  to  take  this  situation  into 
account.  The  eight  columns  in  this  1/8  replicate  show 
how  one  would  assign  the  measurements  to  each  block  so  as 
to  balance  out  any  possible  biases  arising  from  this 
source.  The  particular  measurable  2-factor  interactions 
available,  if  blocking  is  used,  are  listed  alongside  the 
heading  Blocks  only.  Here  we  still  have  13  measurable 
2-factor  interactions.  On  the  other  hand,  even  if  we  take 
into  account  differences  between  blocks,  the  order  within 
a block  might  also  be  important.  This  would  be  the  case 
if  the  measuring  equipment  would  be  subject  to  a drift 
during  the  day.  In  order  to  balance  out  this  possible 
source  of  bias,  the  fractional  designs  have  been  con- 
structed so  that  the  experimental  layout  corresponds  to 
the  proper  orde:.*  of  testing  needed  to  balance  out  any 
biases  arising  from  this  source  of  error. 
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Now  I would  just  like  to  say  a few  words  about 
applications.  In  some  situations  we  might  run  our 
experiments  in  parts  so  that  at  the  end  of  any  part  of 
the  experiment  v/e  can  go  back  and  easily  analyze  the 
data.  For  example,  we  might  run  a 2°  experiment  in  sets 
of  3?  measurements.  That  is,  we  can  run  a 1/8  fraction, 
analyze  it;  if  conditions  warrant,  run  another  1/8 
fraction  to  give  a 1/4  replicate,  etc.  Another  use  for 
these  fractional  plans  is  in  trouble-shooting  a piece 
of  complex  equipment.  In  this  situation  it  is  usually 
possible  to  list  a great  many  possible  factors  which 
could  go  wrong.  However,  the  chances  are  that  only  a 
few  of  these  factors  are  not  functioning  correctly. 

Here  fractional  designs  giving  information  only  on 
main  effects  should  be  useful  in  making  a diagnosis  of 
equipment  malfunctioning. 


This  catalogue  is  for  experiments  where  all  factors 
are  at  two  levels.  However,  by  an  easy  modification  they 
can  be  used  for  experiments  where  all  factors  are  at  4 
levels,  or  in  general,  for  experiments  where  the  factors 
are  all  powers  of  2.  Also,  sometime  later  this  year 
another  catalogue  of  fractional  designs  for  factors  at 
three  levels  will  be  published  by  the  National  Bureau  of 
Standards.  It  is  hoped  that  with  the  publication  of 
these  catalogues  of  fractional  designs,  it  will  make  the 
application  of  fractional  experimentation  more  immediately 
accessible  to  the  applied  statistician  and  the  working 
scientist . 
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THE  DERIVATION  OF  STANDARD  INDUSTRIAL  RATIOS  OF 
INSTRUMENT  ACCURACY  TO  DESIGN  TOLERANCE  SPECIFICATIONS 
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By  Leonard  Janofsky 


STATEMENT  OF  OBJECTIVES 

At  the  time  an  instrument  is  selected  to  measure  a 
design  specification  it  is  the  usual  procedure  in  industry 
to  select  an  instrument  rated  by  the  manufacturer  at  one- 
tenth  the  design  tolerance  required.  This  will  be 
referred  to  throughout  this  report  as  the  ten-to-one  ratio. 

Regardless  of  the  scaler  quantities  involved,  this 
ratio  has  been  applied  as  a rule-of-thumb.  It  will  be 
demonstrated  below  that  the  application  has  resulted  in  an 
excessively  tight  tolerance  being  placed  upon  instru- 
mentation requirements  at  the  high  accuracy  levels.  As  a 
result  there  has  been  considerable  addition  to  instru- 
mentation cost  as  well  as  delay  in  the  design  and/or 
procurement  of  test  equipment. 

The  purpose  of  this  report  will  be  to  present  a 
survey  on  how  the  ten-to-one  ratio  of  design  tolerance 
to  instrument  tolerance  was  derived.  Statistical 
Techniques  for  the  derivation  of  required  new  standards 
will  be  discussed  and  contributions  to  instrument  error 
will  be  analysed  - all  with  a view  toward  replacing  the 
ratio  with  a less  expensive  and  one  which  is  more 
applicable  to  high  accuracy  instrumentation. 

THE  DERIVATION  OF  THE  TEN-TO-ONE  RATIO 

The  selection  of  a ten-to-one  ratio  does  not  have  any 
strong  mathematical  basis.  Where  high  accuracy  is  required 
design  tolerances  are  normally  expressed  in  decimal  form. 
Therefore,  it  has  been  convenient  to  express  instrument 
accuracy  tolerances  in  a readily  convertible  form  as  a 
multiple  of  ten. 

This  conclusion  is  based  upon  a complete  review  of 
the  literature  available  in  this  field,  both  here  and 
abroad.  A blblioabstrar t has  been  constructed  which 
demonstrates  that  no  mathematical  basis  for  this  ratio 
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' was  ever  derived.  In  addition,  industrial  organizations 

employing  this  ratio  were  consulted  and  their  personnel 
bear  out  this  contention  both  as  to  the  derivation  and 
f applicability  of  this  ratio. 

The  industry  has  been  particularly  concerned  with 
justifying  selection  of  the  ten-to-one  ratio  and  several 
projects  have  been  conducted  to  do  this.  For  example, 

Fred  Law  of  the  General  Electric  Co.  demonstrated  that 
an  error  of  approximately  ten  percent  was  present  when 
mechanical  parts  were  inspected  by  15O  inspectors  at 
various  plants  throughout  the  General  Electric  Company. 

In  general,  the  wide  acceptance  of  this  ratio  was 
primarily  due  to  an  intuitive  justification  - i.e.  the 
system  provided  a consistent  measure  which  could  be 
applied  "across  the  board". 

Since  the  ratio  was  used  simply  as  a standard, 
there  need  be  no  mathematical  significance  to  any  specific 
ratio.  It  would  be  preferable,  however,  to  establish 
some  new  ratio  based  upon  the  old  one  in  a manner 
designed  to  readily  convert  values  and  standards  derived 
from  the  ten-to-one  ratio.  The  function  had  served 
industry  well  so  long  as  certain  low  levels  of  accuracy 
were  required.  There  existed  no  requirements  for  a new 
ratio  since  instrumentation  was  not  available  or  required 
for  higher  accuracy  work. 

However,  since  machine  tooling  has  become  capable  of 
maintaining  tighter  tolerance  limits  on  production  units, 
particularly  since  World  War  II,  there  has  been  no 
general  adherence  to  this  ten-to-one  ratio  in  industrial 
practice  at  the  tighter  tolerance  zones.  This  has  been 
due  partially  to  the  expense  and  lack  of  immediate 
availability  of  high  precision  instrumentation.  To  a 
much  greater  extent,  this  has  been  due  to  the  reduced 
requirements  for  such  a tight  ratio  at  the  tighter 
tolerance  levels  due  to  factors  described  below. 

Although  there  has  been  no  general  adherence  to  a 
specific  ratio  the  need  for  a modified  commercial 
standard  has  existed  for  the  past  several  years. 


^Biblioabstract  on  Instrtiment  Error  - Jane  E.  Doolittle, 
Report  rJo.  R56GL233BA-135 > General  Engineering  Laboratories, 
General  Electric  Company,  September  1956. 
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It  would  be  preferable  to  relate  a new  standard  to 
the  previously  derived  ratio  for  obvious  reasons.  Any 
new  standard  must  also  be  flexible  so  that  the  same 
problem  does  not  arise  at  some  future  date  when  metrology 
and  requirements  for  accurate  instrximentation  would  make 
previously  collected  data  incomparable.  Finally,  a 
mathematical  basis  for  a new  standard  would  facilitate 
acceptance  in  industry. 

As  a result,  considerable  demand  has  been  generated 
recently  for  new  standards  of  instrumentation.  It  has 
been  demonstrated  in  industry  that  the  instrument  accuracy 
called  for  at  tight  tolerance  levels  is  not  readily 
available  in  commercial  instruments  without  excessive 
expense  and  time  delay.  It  remains  for  industry  to 
derive  and  accept  a new  standard  more  compatible  with 
the  high  accuracy  instrvunentation  required. 

THE  TREND  OF  HIGH  ACCURACY  INSTRUMENTATION 

The  history  of  high  accuracy  measurement  is  one 
which  originated  with  the  industrial  revolution  and  be- 
came particularly  important  during  and  after  World  War  I.I. 
The  derivation  of  standard  industrial  ratios  of 
manufactured  instrument  accuracy  to  design  tolerance 
specifications  closely  parallels  the  history  of  accurate 
measurement , 

Over  two  thousand  years  ago,  standards  of  measurement 
comparable  to  those  employed  in  engineering  today  were 
obtained.  This  was  primarily  due  to  the  fact  that  factors 
requiring  measurement  were  extremely  rough  compared  to 
the  instrumentation  available. 

The  modern  history  of  accurate  instrxunentation 
originated  with  James  Watt's  steam  engine.  John  Wilkinson’s 
boring  mill  was  producing  a round  cylinder  so  that  a 
"well  worn  shilling"  wouldn't  slip  between  the  piston 
and  bore . 

By  1900,  British  shipyards  on  the  Clyde  were 
employing  a tool  called  the  "micro-meter",  which  (it  was 
claimed)  could  measure  to  one-thousandth  of  an  inch. 

Prior  to  1930  the  need  for  a standardized  ratio  of 
instrument  tolerance  to  design  tolerance  was  not  felt 
strongly  in  the  manufacturing  areas.  The  technological 
development  of  these  measurement  instruments  was  at  a 


stage  which  did  not  require  a functioning  ratio  of  less 
than  10  to  1 - design  specification  tolerance  to 
instrument  manufacturer's  tolerance.  The  reasoning 
behind  the  establishment  of  this  the  ratio  at  a 10  to  1 
level  was  the  inadequacy  of  machine  tools  which,  in  turn, 
required  loose  tolerances. 

Most  of  the  technological  inovations  came  in  the 
area  of  automotive  design.  About  50  years  ago, 

Tol.  William  d'Armody  had  developed  an  automatic 
hydraulic  transmission.  However,  the  hydraulic  slippage 
caused  by  the  loose  tolerances  and  methods  of  production 
made  it  impossible  to  deliver  the  required  power  at  the 
end  of  the  driveshaft.  Standard  instrumentation  had  not 
yet  attained  the  perfection  demanded  of  the  design 
specifications . 

During  World  War  II  fuel-injection  parts  and  ball 
bearing  assemblies  were  some  of  the  areas  requiring 
standards  of  one-five  millionth  of  an  inch.  Production 
requirements  went  to  two  or  even  one-ten-thousandth  of 
an  inch,  forcing  gage  manufacturers  to  employ  20  or  even 
10  millionths  on  some  gages.  Reference  instrument 
manufacturers  were  required  to  go  down  to  two  millionths 
of  an  inch. 

By  19^6  the  industry  was  merely  paying  lip  service 
to  the  ten-to-one  ratio  at  the  tightest  tolerances.  The 
accuracy  of  measurement  and  technological  development 
' rapidly  increased  to  the  stage  where  industry  was  working 

to  a tenth  of  a millionth  of  an  inch  by  means  of  inter- 
ferometry. This  method  is  based  upon  the  precise  splitting 
of  light  waves  to  achieve  the  necessary  measurement 
standards. 

The  trend  in  industry  at  this  point  was  to  develop 
a specialization  in  the  high  accuracy  instrumentation 
field.  For  example,  the  Eli  Whitney  Metrology  Laboratory 
of  the  Sheffield  Corporation,  Dayton,  Ohio  was  established 
to  achieve  this  high  accuracy  instrumentation.  At  present 
the  Large  Steam  Turbine  and  Generator  Department  of  the 
General  Electric  Company  is  developing  a device  which  will 
air  test  experimental  blade  and  chamber  configurations 
L with  a precision  of  + 0.1  percent  at  pressure  ratios 

[ of  1.05”^®  with  inlef  pressures  ranging  from  2 to  l4o  psi. 

I 

I The  best  attainable  accuracies  in  electrical 

\ instruments  have  been  periodically  compared  to  the  accuracy 

! of  the  ordinary  commercial  products.  In  England,  considerable 

I I 

; I 
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work  has  been  performed  by  the  National  Physical  Laboratory 
which  provides  an  indication  of  the  quality  of  these  manu- 
factured products . 


The  moderate  accuracies  for  British  Ammeters  specified 
in  B.S.  89  1957  or  in  the  Electricity  Supply  (meters)  Act 
of  1936  in  England  were  not  achieved  in  33  percent  of  the 
Instzniments  submitted  to  the  N.P.L.  for  test  in  the  years 
1945  - 1950.  Since  most  of  the  defective  instruments  were 
repaired  and  eventually  passed  their  tests,  it  would  appear 
that  approximately  one-half  of  the  ammeters  submitted  to 
the  N.P.L.  for  test  failed  initially. ^ 

This  has  been  attributed  not  so  much  to  a deterioration 
of  the  quality  of  instruments , but  rather  to  a technological 
Improvement  in  methods  of  measuring  and  testing  these 
^ instiruments , indicating  that  possibly  instniments  were 

inherently  not  of  the  quality  that  they  were  once  thought 
to  be.  The  previous  ratings  of  these  instruments  were 
overstated  and  the  applicability  of  the  cen-to-one  ratio 
^»as  established  with  less  accurate  Instruments  than  was 
previously  s\ispected.  In  all  probability,  a five-to-one 
ratio  may  have  been  employed  to  assert  proof  of  Industrial 
applicability  of  the  ten-to-one  ratio.  A ten-to-one  ratio 
requirement  placed  upon  an  instrxment  in  1930  would 
constitute  a more  stringent  requirement  on  the  Identical 
test  system. 

MANUFACTBTtER’S  ERROR  IN  ELECTRICAL  INSTRUMENT  CONSTRUCTION 

Precision  of  an  instrument  is  defined  as  the  internal 
consistancy  of  the  instriunent . The  complete  understanding 
♦ of  the  appearance  of  errors  and  how  they  are  affected  by 

* details  of  construction  and  method  of  use  of  the  measuring 

instrument  is  prerequisite  to  any  discussion  of  reliability 
of  measurement. 

Electrical  instz*uments  are  too  often  regarded  more 
as  pieces  of  apparatus  to  be  standardized  against  similar 
Instruments  of  higher  accuracy  than  as  measuring  devices  to 
be  Introduced  into  a circuit  to  determine  the  condition  of 
the  circuit.  However  accurate  an  instrtunent  may  be  when 
tested  as  a unit,  if  this  introduction  Into  a circuit  dis- 
turbs the  circuit  conditions,  the  instrument  reading  may 
be  of  little  consequence.  The  tighter  the  tolerances  to 

^Pe'rformance  Limits  in  Electrical  Instruments  - Arnold  A.H.M. 
Proc.'  r.E.E.  "98  Part  5T7C)1  (1951). 
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which  the  circuit  is  being  subjected,  the  lower  the 
significance  of  the  ten-to-one  ratio.  The  instrument  will 
not  disturb  the  circuit  as  a linear  function  of  the 
accuracy  required.  The  disturbance  caused  by  the  intro- 
duction of  a test  instrument  is  a function  of  the  circuit 
design  - not  of  the  instrument  accuracy. 

In  accessing  the  value  of  instrtiments , their 
limitations  must  to  a large  extent  be  regulated  by  the 
circuit  conditions  into  which  they  may  be  connected. 

The  influence  of  the  introduction  of  these  errors  should 
be  included  when  an  instrximent  is  being  selected  for  a 
particular  measurement.  The  contributing  influence 
should  be  considered  part  of  whatever  ratio  is  selected. 

The  ability  of  a test  to  detect  small  variations  in 
the  characteristic  to  be  measured  is  of  basic  importance. 
The  characteristic  of  an  Instimment  that  it  can  produce 
consistent  results  is  not  necessarily  a desirable  one 
where  measurements  of  small  variations  in  the  measured 
mediiim  are  required. 

The  defects  which  distinguish  a manufacturer's 
product  and  special  laboratory  models  may  be  divided 
into  two  classifications: 

Class  "A"  Defects  (not  easily  detected  by  the  \iser.) 

1)  Resistors  incorrectly  adjusted 

2)  Errors  in  scale 

3)  Power-factor  errors  in  watt  meters 
4 \ Level  errors 

5)  Self-heating  errors 

6)  Movements  sticking  at  one  or  more  positions 

7 ) Variability 

Class  "B"  Defects  (easily  detected  but  liable  to  be  a 
source  of  error  if  not  rectified).  The  Class  "B" 
defect  is  a function  of  level  of  inspection  and  sub- 
sequent handling  of  the  manufactured  instrument. 

The  precision  of  the  manufacturers’  average 
product  is  appreciably  below  that  of  the  special 
laboratory  model  - with  the  exception  of 

l|  Potentiometers 

2)  Standard  resistance 

3)  Standard  cell 

4}  Instrument  transformers 
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The  errors  Included  in  electrical  measurement  are 
broadly  divided  into  two  main  classes . 

(a)  The  Accidental  Errors.  These  are  due  to  elements 
over  which  we  have  little  direct  control  such  as 
noise  or  smoke  in  the  laboratory,  vibration  of 
the  building  and  physical  conditions  of  the 
experimenter. 

The  physical  conditions  of  the  experimenter  may 
be  further  broken  down  into  fatigue,  faulty  and 
Incompetent  manipulation  and  lack  of  practice 
or  knowledge. 

Although  little  direct  control  can  be  maintained 
over  this  source  of  error,  it  is  still  an 
important  function  of  the  errors  which  have 
habltiially  been  excluded  from  the  ten-to-one 
ratio  and  might  well  be  considered  as  a future 
addition  to  it.  It  may  be  well  to  derive  two 
additional  ratios  - one  for  physical  factors 
and  one  for  the  human  elements . 

(b)  Systematic  Errors.  These  are  the  errors  Inherent 
in  the  equipment  and  the  method  used.  They  are 
also  dependent  upon  some  of  the  conditions  under 
which  the  experiment  is  conducted;  conditions 
which  are  known  and  the  influence  of  which  can 

be  eliminated,  minimized  or  calculated. 

The  most  important  of  the  systematic  errors  is  the 
constructional  error.  This  error  arises  because  the 
equipment  can  be  guaranteed  only  where  certain  assumptions 
are  held  valid.  For  example,  the  effects  of  frequency, 
self-inductance,  and  distributed  caoacity  should  be 
submitted  by  the  manufacturer  (either  by  a formula,  graph, 
or  phase  angle)  from  which  the  constructional  error  can 
be' calculated. 

This  information  should  be  provided  to  all  statistical 
analyses  of  the  results  of  such  testing  - along  with  the 
specifications  of  the  test  conditions. 

Inductances,  mutual  Inductances,  and  capacities, 
have  their  constructional  error  indicated  in  a similar 
way,  and  the  same  applies  to  tuning-forks,  wavemeters, 
generators,  instruments,  etc. 

With  indicating  Instruments  such  as  voltmeters, 
ammeters,  etc,  the  constructional  error  is  rarely  uniform 
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over  the  entire  scale.  It  is  usually  greatest  in  the 
first  third  of  it.  The  manufacturer  may  therefore  indicate 
the  error  as  say,  +0.5  percent  in  the  rest.  Naturally, 
any  derived  ratio  should  be  a function  of  the  non-uniform 
constructional  error  where  high  accuracy  instrumentation 
is  involved.  The  errors  Introduced  become  proportionately 
more  important  as  the  accuracy  increases. 

In  some  cases  the  constructional  error  may  be 
indicated  by  significant  figures.  A significant  figure 
constructional  error  would  be  digit  which  is  thought  to 
bo  nearer  to  the  "true  value"  than  is  any  other  digit. 

This  is  most  often  used  in  guarantee  certificates.  For 
example,  an  Inductance  may  be  expresses  as  125500  mh  or 
1.255  X lo5  mh,  which  means  that  the  "true  value"  is 
between  125^00  mh  and  I25600  mh.  The  limits  expressed 
as  a percent  are  here  + 100  x 100  = + 0.0797  = 

1‘75500 

+0.08  percent.  The  first  four  digits,  1255#  are  the 
significant  figures,  and  the  Inductance  is  given  to  four 
significant  figures. 

In  whatever  manner  the  constructional  error  is  given, 
it  is  best  converted  into  a percentage  for  the  calculation 
of  the  maximum  possible  error. 

Again,  when  a resistance  is  given  as  12222  ohms  or 
to  five  significant  figures,  it  means  that  its  value  lies 
between  12221  ohmes  and  12223  ohmes.  Zeros  are  significant 
figures  only  when  other  digits  precede  them  in  the 
nximber;  thus  0.0125  has  three  significant  figures  and 
not  five.  The  more  significant  figures,  the  greater  the 
accuracy  of  the  measurement. 

A substantial  reduction  in  the  amount  of  error  in 
electrical  instrumentation  is  not  expected  in  the  near 
future.  Further  substantial  advances  in  the  accuracy 
of  the  best  Instrximents  under  favorable  conditions  are 
not  to  be  expected.  In  most  cases  standard  commercial 
instruments  have  undergone  only  detail  changes  in  the  past 
few  years . Advances  which  may  be  expected  will  be  with 
a view  toward  extending  the  range  of  conditions  for 
maximum  accuracy.  The  technological  developments  are 
expected  in  the  relm  of  a reduction  in  the  margin  of  per- 
formance between  the  specially  adjusted  Instrument  and  the 
ordinary  level  dt  commercial  instrumentation.  Additional 
technological  improvements  can  be  expected  in  a reduction 
of  the  number  and  magnitude  of  the  corrections  to  be 
applied  to  an  Instrximent  reading. 
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"TRUE  VALUE"  ERROR 


The  "true  value"  of  a variable  is  defined  by  fixed  j 

points  or  by  standards.  The  "true  value",  therefore,  j 

could  conceivably  be  an  approximation.  By  the  replication  | 

of  the  "true  value"  of  the  variable  and  by  a statistical 
review  of  the  consistancy  of  the  results,  a function  can  ;< 

be  derived  which  is  interpreted  as  a measure  of  the  pre- 
cision or  maximum  variation  in  indication  that  will  occur.  i 

The  precision  function  can  be  expressed  as  the  positive  | 

and  negative  difference  between  a given  measurement  and 
the  average  indication  for  a given  true  value  found  from  f 

several  independent  determinations.’  | 

It  can  readily  be  seen  that  since  the  "true  value"  j 

is  determined  by  the  quality  of  the  standard  which,  1 

in  turn,  depends  upon  intercomparison  methods,  uncertainty  ? 

could  conceivably  be  introduced  into  the  measurement  { 

regardless  of  the  basic  design  of  an  instrument. 

Any  error  introduced  v/hich  is  dependent  upon  the 
basic  standards  is  thus  a constant  error  not  dependent 
upon  the  magnitude  of  the  reading.  The  "true  value 
error",  therefore,  would  always  be  present  when  any 
instrument  is  compared  to  a standard.  This  error  is 
negligible  where  the  magnitude  of  measurement  is  large,  . 

but, its  contribution  to  the  total  error  increases 
significantly  at  the  extreme  values,  thus: 


Contribution  of  True  Value  Error  to  Total  Error 

(in  percent) 

Percent  contribution  FIGURE  I 

to  total  Instrument 
error . 


Magnitude  of  Measurement 

Note  3 - Measurement  Errors  - Classification  and  Inter- 
profatTon  iUI  Boo  ns  ha  rT.  TransaefTons  of  the 


Our  discussion  will  center  about  the  area  between 
M,  & M-.  The  portion  represents  a technologically 

unattainable  degree  of  accuracy.  The  area  to  the  right 
of  Mg  represents  the  area  for  which  the  10  to  1 ratio 
was  derived.  The  importance  of  the  "true  value"  error  can 
be  demonstrated  by  Figure  II. 


Ass\ime  an  instrument  capable  of  becoming  more  and 
more  technologically  accurate.  Measure  the  error  on 
the  ordinate. 


Magnitude  of  Measurement 
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We  aro  still  only  concerned  with  the  area  between 
Ml  and  Mg  However,  it  will  be  noted  that  althought  the 
contribution  of  this  "calibration"  error  to  total  error 
is  at  a constant  percentage,  the  total  error  gradually 
rises  to  the  left  between  - between  Mj  and  Mg  the  ratio 
changes  drastically  until  it  is  almost  the  inverse  of 
the  original  ratio 

In  realistic  terms,  this  means  that  if  our  assumptions 
are  true,  it  may  be  necessary  to  shift  the  emphasis  to 
calibration  and  standardization  techniques  etc  - none 
of  which  are  concerned  with  the  technological  construction 
of  the  Instrument  - technological  construction  of  an 
instrument  is  related  almost  entirely  to  the  force/ 
friction  ratio  of  the  receiving  or  measuring  element 
and  the  linkage  system  and  accessory  units  which  the 
element  is  required  to  drive  Thus  at  the  higher  accuracy 
instruments  at  the  tightest  magnitude  of  measurement 
possible  the  ten-to-one  ratio  may  possibly  be  abandoned 
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THE  "PROBABLE  ERROR" 


The  notion  of  probable  error  is  now  very  much 
obsolescent.  However,  since  the  ten-to-one  ratio  was 
derived  while  the  "probable  error"  concept  was  still 
popular,  some  discussion  of  an  approach  to  a new  ratio 
should  be  based  upon  this  function. 

The  understanding  of  the  Normal  Probability  Curve 
is  rather  general.  The  scale  of  "t"  values  (corresponding 
to  standard  deviations)  is  graphically  Illustrated  by 
figure  III. 

FIGURE  III 


The  term  "probable  error"  notes  + 0.6745(3^,  and 
represents  a deviation  .just  as  likely  to  be  exceeded 
as  not  that  is,  the  5'^  percent  probability  that  the 
value  has  been  met . 

The  probable  error  always  was  considered  an  in- 
accurate statistical  tool  Although  it  3s  doubtful 
that  a mathematical  basis  for  the  ten-to-one  ratio 
existed,  there  is  strong  evidence  that  if  it  were 
supported  from  statistical  methodology,  it  would  have 
been  based  upon  the  probable  error  rather  than  the 
presently  usual  three-standard  deviation  concept.  For 


^Facts  from  Figures  - fl.  J.  Moroney,  Penguin  Books, 
Bartlmore,"  1'953-  P'  11^+ 
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example,  5'^  percent  of  the  area  under  the  normal  curve 
falls  within  the  "probable  error"  area.  A plus  or  minus 
five  percent  allowance  for  exogenous  factors  (in  this 
case,  instrument  error)  gives  a ten-to-one  ratio  of 
endogenous  to  exogenous  variables. 

This  5 percent  allowance  at  the  tails  of  the  dis- 
tribution is  still  a very  popular  one  and  is  reflected 
in  the  + 2 sigma  standard  deviation,  representing 
approximately  95  percent  of  the  area  under  the  normal 
curve . 

The  inaccuracies  inherent  in  a probable  error 
analysis  require  particularly  stringent  instrument 
tolerances  Since  design  specifications  today  are 
established  at  the  two  or  three  standard  deviation  limit, 
the  ten-to-one  ratio  might  be  revised  in  a direction 
which  would  permit  instruments  of  less  accuracy  to  be 
employed . 

EXAMPLE  OF  THE  APPLICATION  OF  A NEW  RATIO 


This  section  will  suggest  a method  of  deriving  a 
ratio  applicable  to  a given  control  chart,  "^ith  a 
given  design  specification  the  newly  derived  ratio 
should  provide  a logical  basis  for  substitution  of  another 
more  (or  less)  accurate  instrument  as  applicable  to  the 
particular  problem  - rather  than  selected  arbitrarily. 

A Full-Wave  Rectifier  was  being  tested  for  use  in 
an  instrumentation  circuit.  One  hundred  fifteen  (115) 
volts  490  c.p.s.  alternating  current  was  being  put  into 
a black  box  and  specifications  required  that  an  output 
of  150  volts  direct  current  be  achieved  Particular 
attention  was  directed  toward  the  low  temperature  range 
to  determine  the  operation  of  this  unit  under  severe 
arctic  environment  conditions 

At  the  lower  temperatures,  the  capacitance  was 
reduced  and  ripple  voltage  increased  (presumably  eratically) 
to  a point  where  it  exceeded  the  200  millivolts  r.m.s. 
upper  control  limit  of  the  design  specification. 

The  instrument  employed  to  determine  the  ripple  was 
an  AC  Vacuvim-Tube  voltmeter  with  a manufacturing  accuracy 
of  3 percent.  However,  a 2 percent  accuracy  was  obtained 
through  calibration.  On  the  one  volt  scale  this 
corresponded  to  + 20  millivolts. 
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Assuming  that  the  design  tolerance  had  been  set  at 
200  millivolts,  the  ratio  of  design  tolerance  to  instrument 
accuracy  was  ten-to-one 

Temperature  readings  were  taken  within  the  range 
of  0°C  and  -50°  and  ripple  increased  from  40  mv  until 
the  design  tolerance  was  exceeded  at  -30°C.  (See  Figure 
IV).  This  actual  reading  at  -30°C  was  I85  mv.  Test 
specifications  required  that  +20  mv  be  added  to  the 
actual  reading. 

However  it  was  determined  that  more  accurate 
instrumentati jn  should  be  employed  so  that  it  might  be 
possible  to  bring  this  equipment  to  within  specification 
limits  at  -30°C. 

The  use  of  a 1 percent  voltmeter  was  recommended. 

The  tolerance  would  be  tightened  to  a + 10  mv,  and  the 
rectifier  would  be  within  specified  toTerance. 

The  derived  ratio,  however,  is  now  20  to  1.  The 
decision  to  employ  this  tighter  ratio  can  be  justified 
statistically  only  by  a thorough  analysis  of  the  data. 

New  mathamatical  techniques  - presumably  based  upon 
the  expected  variability  of  the  process  - must  be 
standardized  employed  in  industry. 


FIGURE  IV 
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The  process  has  gone  out  of  control  at  the  -30°C 
reading  due  to  the  wide  spread  allowed  for  instrmient 
error.  The  200  mv  has  been  used  as  a control  limit  and 
is  based  solely  upon  the  design  tolerance.  The  ratio 
of  the  instrument  accuracy  to  the  design  tolerance 
could  be  based  upon  the  slope  between  the  upper  instrument 
tolerance  and  the  lower  instrument  tolerance  of  the 
previous  reading.  Angle  oC  ^ is  the  ratio  function. 

f(0<i)  = T^  ✓ 1 (1) 

Td  \ TO" 


where  Tij^  is  the  instrument  tolerance 
Td  is  the  design  tolerance 

Assume  the  same  readings  taken  with  the  second 
instrument  and  an  angleo^  is  derived  in  a similar 
manner , thus : ^ 

FIGURE  V 
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In  this  case  an  instriiment  tolerance  of  10  mv 
(Ti2)  has  presented  a more  accurate  picture  of  the 
process  going  out  of  control.  Thus  we  have  the  angle 
(oC  ) as  a ratio  function. 

2 


fKp)  = 1 

2 Ta“  \ ITT 


(2) 


The  design  tolerances  remain  at  200  mv.  The  instrument 
tolerance  is  now  to  be  tightened  and  it  is  required  to 
determine  to  what  new  ratio  we  must  work. 


Where  formerly,  from  equation  (l) 


f(<Kl) 


Til  = 1 


(The  bar  denotes  known  values) 


now 

f((X  2)  = lia 
Td 


equating  (l)  + (2)  

Ti  = lC^p)Tii 
2 


(3) 


The  f (O^  ) function  is  derived  as  follows: 

Let  the  upper  tolerance  value  be 
designated  as  "u";  let  the  lower 
tolerance  value  be  designated  as 

II  If 


Then  the  angle  generated  by  the  slope  of  the  line 
is  computed  as: 


"4  - h 
- 3) 


Tan  Oj^ 


(4) 


The  angle  generated  by  the  slope  of  the  line 
is  computed  as: 
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SinceC><^  is  composed  of  positive  contribtuions  from 

0 & ;zr, 

®1  - /l  = 0^1 
in  the  general  case: 


e - ^ = o<.  (6) 

Similarly,  the  f(p^„)  function  is  derived  from  the 
figure  V. 


"s  - H 

(s-'t) 


tan  ©2 


""4  - S 

(4-5)' 


from  equation  (6) 

©2-^2  = ^2 

This  process  is  repeated  until  the  entire  previous 
history  of  the  phenomenon  is  incorporated  into  a new 
instrument  accuracy  requirement.  The  purpose  of  this 
derivation  is  to  present  a value  (^)  which  could  be 
used  in  a new  ratio.  The  function  incorporates  both  a 
factor  related  to  instrument  accuracy  and  variability 
of  the  process.  For  example,  where  the  process  is  not 
excessively  variable,  tight  instrument  requirements  are 
Justified.  Therefore  there  exist  some  justification 
for  a tighter  ratio;  20  to  1. 

CONCLUSION 


The  purpose  of  presenting  these  statistical  tools 
has  been  to  suggest  an  approach  to  the  derivation  of  a 
new  standard.  Obviously,  there  could  be  many  other 
methods  of  deriving  new  ratios.  It  has  been  demonstrated 
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that  the  previous  standard  is  inapplicable.  However, 
any  new  standard,  by  definition,  requires  the  concerted 
approval  of  those  industrial  operations  most  directly 
affected. 

The  need  for  this  derivation  has  been  clearly 
expressed  to  the  author  during  consultation  with  various 
industrial  organizations.  The  approaches  proposed 
above  are  neither  complete  nor  mathematically  rigorous 
and  no  attempt  is  made  to  make  them  so  - this  being 
beyond  the  scope  of  the  report . It  remains  for  the 
statisticians  of  the  industrial  organizations  to  agree 
upon  the  derivation  of  a set  of  ratio  standards  satis- 
factory to  industry  as  a whole. 

The  initial  step  in  such  a program  is  a complete 
compilation  of  literature  available  both  here  and 
abroad  related  to  instrument  accuracy.  The  enclosed 
biblioabstract  is  intended  as  an  initial  step  in  the 
performance  of  this  function. 
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STATISTICAL  DEVELOPMENTS  IN  LIFE  TESTING 


I 


I 


I 


(a) 


Benjamin  Epstein 
Department  of  Statistics 

Wayne  State  University 
Detroit,  Michigan 


Summary 


In  this  paper  we  describe  recently  developed  statistical 
methods  for  analyzing  data  arising  from  life  tests  and  for 
designing  life  tests.  Advantage  is  taken  of  the  time  ordered 
nature  of  life  tost  data  to  shorten  substantially  the  time 
required,  to  reach  a decision.  Most  of  the  results  have  been 
obtained  under  the  assumption  of  an  exponential  distribution 
of  life.  Replacement,  non  replacement,  sequential,  non 
sequential,  and  truncated  procedures  are  described.  Some 
useful  tables  are  given  at  the  end  of  the  paper. 

It  is  a characteristic  feature  of  most  life  and  fatigue 
tests  that  they  give  rise  to  ordered  observations.  If,  for 
example,  tv/enty  radio  tubes  are  placed  on  life  test  and  t^ 
denotes  the  time  v/hen  the  ith  tube  fails,  the  data  occur 
in  such  a way  that  tj  ^ t2  ^ • • • ^■^20-  Exactly  the  same 

kind  of  ordered  situation  will  occur  whether  the  problem 
under  consideration  deals  with  the  life  of  electric  bulbs, 
the  life  of  elec^^ronic  components,  the  life  of  ball  bearings, 
or  the  length  of  life  of  human  beings  after  they  are  treated 
for  a disease.  The  examples  we  have  just  given  all  involved 
ordering  in  time.  This  need  not  necessarily  be  the, case. 

If  we  are  interested  in  destructive  test  situations  involving 
such  things  as  the  current  needed  to  blow  a fuse,  the  voltage 
needed  to  break  down  a condenser,  the  force  needed  to  rupture 
a physical  material,  then  we  can  often  arrange  to  test  in 
such  a way  that  every  item  in  the  sample  is  subjected  to 
precisely  the  same  stimulus  (current,  voltage,  stress).  If 
this  is  done,  then  clearly  the  weakest  item  will  be  observed 
to  fail  first,  the  second  weakest  next,  etc.  In  the  present 
paper  we  discuss  almost  exclusively  situations  in  which  it 
is  the  time  to  failure  that  is  the  important  random  variable, 
and  therefore  we  shall  use  the  language  of  time  throughovit 
the  paper.  It  should  be  emphasized,  however,  that  there  will 
be  some  practical  problems  which  do  not  involve  time,  but  for 
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v/hich  some  of  the  ideas  discussed  in  this  papei’  are  quite 
relevant . 

Put  in  general  terras,  we  test  n items  drawn  at  random 
from  some  population  and  the  data  become  a’/ailable  in  such 
a way  that  the  smallest  observation  comes  first,  the  second 
smallest  second,  . . . , and  finally  the  largest  observation 
last.  Clearly  we  can,  if  we  choose,  discontinue  experimen- 
tation long  before  all  n items  have  failed.  In  particular 
we  may  decide  to  terminate  the  experiment  as  soon  as  v/e  have 
the  first  r (^n)  failures,  or  v/e  may  decide  to  stop  at  some 
prreassigned  truncation  time  T^,  or  we  naj^  adopt  a sequential 
procedure  permitting  us  to  stop  as  soon  as  certain  conditions 
are  met.  In  all  of  these  cases  our  primary  concern  is  the 
development  of  statistical  procedures  which,  by  taking  advan- 
tage of  the  fact  that  data  become  available  in  order,  will 
enable  the  experimenter  to  reach  a decision  in  a shorter 
time  or  with  fewer  observations,  than  would  be  possible  if 
data  did  not  become  available  in  a tine  ordered  way. 

II.  Preliminary  remarks  on  the  exponential  distribution . 

In  this  paper  virtually  all  results  v;ill  bo  obtained 
vxnder  the  assumption  that  the  length  of  life  X has  an 
exponential  distribution  described  by  the  probability 
density  function  (henceforth  abbreviated  as  p.  d.  f.) 
f(x;0)  of  the  form 

(1)  f (x;0)  = i e-x/e,  X > D,  0 > 0 
0 

= 0,  elsewhere. 

A partial  .justification  for  this  assumption  has  boon 
discussed  in  some  detail  by  the  author (see  ref(l))  and  several 
relevant  referexices  are  given  in  that  paper.  Quite  re- 
cently further  evidence  of  an  empirical  nature  can  i:>e 
foxuid  in  a series  of  ARINC  monographs.  We  are  v/ell  aware 
of  the  fact  that  many  life  disti^ibutions  are  not  a.dequatel3f 
described  by  equation  (1).  TIo-.vever,  we  feel  that  aai  under- 
standing of  the  theory  in  the  exponential  case  is  essential 
if  we  are  to  treat  more  general  situations.  In  fact,  in 
some  cases,  the  solution  for  a p.  d.  f.  which  is  not  of  the 
form  (l)  can  be  readily  obtained  by  making  triv'ial  modifi- 
cations of  the  results  in  the  exponential  case.  Wo  intend 
to  discuss  this  question  in  detail  in  another  paper.  ^ 

F 

Returning  then  to  the  p.  d.  f.  (1)  wo  state  some  results 
which  are  discussed  in  detail  in  a paper  b^/  Epstein  and  Sobel 
(see  ref.  (3))-  Tlie  first  result  is  as  follovs:  Let  n items 


be  drav/n  at  random  from  a distribution  whose  p.  d.  f.  is 

"iven  by  (l)  and  placed  on  life  test.  Lot  the  observations 

become  available  in  order,  i.e.,XT_6Xo 

-I-  > n c , n ^ « r , n ^ 

. . . ^ X where  by  x.  is  meant  the  time  when  the  i ' th 
> n,n  i,n 

failure  occurs.  Suppose  that  experimentation  is  discon- 
tinued as  .soon  as  the  r'th  item  fails  (r  is  preassigned), 

then  it  can  be  shown  that  the  maximum  likelihood  estimate 

of  the  mean  life(^)  © is  given  by  ^r,n  where 


X + x„  + 
l,n  2,n 


X + (n-r)  X 
r , n ' r , n . 


In  words  we  add  up  the  total  number  of  hours  lived  by  all 
items,  those  that  failed  and  those  which  did  not  fail,  and 
divide  by  the  number  of  failures.  The  estimate  _ is 

"best”  in  the  sense  that  in  addition  to  being  maximum 
likelihood,  it  is  also  unbiased,  minimum  variance,  efficient, 
and  sufficient.  The  p.  d.  f.  of  ^ is  given  by 

(3)  ^£-,(7)  = 1 (r/ey  y e , y > 0 

(FTF: 

= 0,  elsewhere 

and  j^/6  is  distributed  as  chi-square  with  2r  degrees 

of  freedom  (which  ,ve  denote  as  ^^(2r)). 

In  the  preceding  paragraph  we  have  been  concerned 
with  the  non-replacement  situation  where  one  does  not 
repla.ce  failed  items  at  once  by  new  items  drawn  from  the 
underlying  p.  d.  f.  (l).  In  the  replacement  case  (where 
one  immediately  replaces  a failed  item  by  a new  one)  it 
can  be  shown  that  the  maximum  likelihood  estimate  of  the 
mean  life  6 is  given  by 


^r,n  = « ^r,n/^’ 

whore  by  x...  is  meant  the  total  time  (measured  from  the 

beginning  of  the  life  test)  to  observe  the  r'th  failure  and 
where  the  sample  size  n is  maintained  throughovit  the  life 
test.  It  should  be  remarked  that  nxp  q is  the  total  number 


X — dx  = e. 

jo  e 
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of  hours  livofl  by  evil  items  on  tost  sinco 


= ux,  + n(xo  _ - X,  )+  n(x,  -x^  ) 

',n  l,n  ^2,n  l,n^  2,n' 

+ + n(x  -X  , ). 

r , n j.  - i , li 


On  the  rirththancl  side  of  (5)>  nx  is  tho  number  of  hours 

1 , n 

lived  ’03?  all  items  up  to  the  tine  the  first  failux-e  occurred, 
a.nd  n(x^  ^ ^ is  tho  number  of  hours  lived  by  all 

items  between  the  tines  of  occurrence  of  the  (i-l)st  failure 
and  i ' th  fa? lure.  The  estimate  (4)  in  tho  replacement  case 
has  precisol:/  the  same  distribution  and  tho  same  optimnn 
properties  as  does  tho  estimate  (2)  in  the  ncn-roplacemant 
case.  In  fact  if  ve  lot  be  the  total  n’umber  of  hotvrs 

live?!  b3?  all  items  -vhether  thej?  "ailed  or  not,  up  to  tho 
time  when  the  r’th  failure  occurred,  one  can  v/ritc  both 
(2)  and  (4)  as 

^r,n  = 


where 


T„  „ = X,  „ + x_  + . 
1 , n 2 , n 


-l,n  + + 1) 


in  the  non-replacement  case  and  where 

T = nx 

r , n r , n 

in  the  replacement  case.  In  either  case,  2T^  is 

distributed  as  X ^ (2r). 

An  interesting  and  important  feature  of  the  distribution 
of  either  the  replacement  ox-  non-replacement  cr.se  is 

its  independence  of  n.  It  therefore  follows  that  no  matter 
what  n js  a 100 (l  - oc  ) percent  confidence  interval  for  tho 
true  but  unknown  mean  life  6 based  on  a tost  terminated  after 
one  has  observed  tho  first  r out  of  n failures  is  ffiven  by 

(7\  / 2-c^  2r  \ / 2T„  2T„ 


(2r) 


I 
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T/hore  \V3  define  the  constant  (2k)  bji'  the  equation 

(8)  Pr  (2k)  > (2k)^  = 

dimilarly,  suppose  v/e  want  to  find  a test  procedure 
which  will  f^ive  a prescribed  operating  characteristic  curve 
(henceforth  abbreviated  as  O.  C.  curve).  Put  in  statistical 
terns  (*^)  we  want  to  test  the  hypothesis  Hq  : 6 = Sq  against 

the  alternative  : 0 = ^ ©^  subject  to  the  conditions 

that  for  6 = ©Q,  L(©q)  = Pr (accepting  © = ©q  | 6q  is  true) 

= 1 - ot  and  for  © = ©j^ , L(©j^)  = Pr  (accepting  © = ( ©1 

is  true ) ^ ^ . It  is  shown  in  our  paper  (5)  that  the  region 
of  acceptance  for  © = ©q  must  bo  of  the  foran 


‘r,n  > C = ©o  (2r)/2r, 

1 — 0^ 


whei’e  the  0.  C.  curve  based  on  this  region  of  acceptance 
must  be  indepondent  of  n,  since  the  distribution  of  „ 

depends  only  on  r.  The  appropriate  values  of  r (and  hence 
C)  for  certain  values  of  o<_  , ^ , and  Q^/Q-^  are  given  in 

Table  1 . For  values  of  oC  , ^ , and  ©o ' given  in  the 

table,  the  appropriate  r to  use  is  the  smallest  integer 

r such  that  X!  ’/Xa  ^ 

1—  ^ ^ 


In  the  test  procedure  0^,  ^ C,  the  sample  size  n is  at 

oui’  disposal.  The  effect  of  increasing  n is  to  shorten 
the  time  needed  on  the  average  to  reach  a decision  and 
thus  if  we  happen  to  be  in  a situation  where  the  items 
being  tested  are  cheap  but  -where  time  is  very  valuable, 

■70  may  -well  prefer  a test  of  the  form  > C to  one 

which  is  of  the  form  6j,  > C.  These  two  procediires 

hv^e  exactly  the  same  o!  C.  curve  and  our  only  reason 
for  preferring  n.  rule  of  action  based  on  the  first  r 
failures  out  of  n items  tested  to  one  based  on  failing 
all  r out  of  r items  is  that  the  first  rule  of  action 
will  take  a shortei*  time  on  the  average.  Thus,  for  example, 


©f,  is  come  acceptable  (high)  mean  life,  ©j  is  some  un- 
acceptable (low)  moan  life,o<.is  the  producer's  risk  and 
^ is  the  consumer's  risk. 
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a test  procedure  which  involves  stopping  an  experiment  after 
the  first  of  two  items  on  test  has  failed  will  load  to  rules 
of  action  whose  0.  C.  curve  is  precisely  the  same  as  that 
found  by  placing  one  item  on  test  and  waiting  until  it  fails. 
However,  the  expected  length  of  time  in  the  first  procedure 
is  only  one  half  that  in  the  second  procedure.  Consequently, 
if  the  time  saved  outweighs  the  loss  due  to  testing  two  items 
rather  than  one,  wo  would  prefer  the  first  procedure. 

Let  E(Xj.  n)  be  the  expected  length  of  time  needed  to 
observe  the  first  r failures  out  of  n items  placed  in  test, 
and  let  E(Xj,  be  the  expected  length  of  time  needed  to 
observe  all  r items  to  fail,  if  r items  are  placed  on  test, 
then  the  ratio 


is  a measure  of  the  expected  saving  in  tine  due  to  using 
the  first  procedure  as  compared  with  the  second  procedure. 

In  table  2 we  give  the  values  of  this  ratio  for  selected 
small  values  of  r and  n,  in  the  non-replacement  case.  This 
table  shows,  that  if  "time  is  money",  procedures  which  ter- 
minate before  the  whole  sample  is  observed  may  be  very  .ad- 
vantageous. In  evaluating  (lO)  the  following  formulae  are 
useful : 

(11)  E(X^^„)  = 6 (i  +3^  + ...  51^  H-l  ) - e i l/(n-j+i) 

J = 1 

in  the  case  where  failed  items  are  not  replaced  and 


(12)  E(X  ) = rO/n 

' ' r,n' 

in  the  case  where  failed  items  are  replaced  at  once  by  new 
items  drawn  from  the  p.  d.  f.  (l) 

III  Truncated  life  tests 

It  is  frequently  necessary  on  practical  grounds  to 
terminate  a life  test  by  a preassigned  time  Tq.  This 

leads  to  truncated  tests  in  which  it. is  decided  in  advance 

that  the  life  test  will  be  terminated  at  min  (X-  ,,, . T^ ) 

^ o ’ o 

where  Xi.^,n  is  the  time  at  which  the  r^  ’ th  failure  occurs 
and  Tq  is  the  truncation  time  beyond  which  the  life  test 
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not  bo  nllov/od  to  run.  If  tho  life  test  is  torninntecl 
at  n (i.G.,  failures  occur  before  time  T ) then  the 

action  taken  ’.vill  be  to  re.'ect.  If  the  experiment  is  ter- 
minated at  time  Tq  (i.e.,  tho  r^ ' th  occurs  after  time  ) 

then  tho  action  in  terras  of  "hypothesis"  testing  is  accep- 
tance. In  a paper  by  Epstein  (see  ref.  (4))  one  can  find 
details  concerning  such  test  procedures  for  both  the  re- 
placement and  non-replacoment  cases.  These  test  procedures 
arc  characterized  by  throe  functions  E^(r),  Eq(T) , and  L(0), 

the  expected  number  of  observations  to  reach  a decision,  the 
expected  waiting  time  to  reach  .a  decision,  and  tho  probability 
of  accepting  respectively,  if  0 is  the  true  value.  The  formulae 
are  given  belo.v. 

In  tho  non-replacoment  case 


(15)  Ec,(r)  = np 


0 


^•o  -2 
S 

k = 0 


+ r 


r -1 
o ^ 

Z 

k = O 


where 


-T  /e 


= 1 _ 


and  b(k;n,pQ)  =[  | pg  (l-Pe) 

k , 


n-k 


The  probability  distribution  of  r is  given  by 

(14)  Pr(r  = k I 0)  = b(k;n,pQ),  k = 0,  1,  2,  . . . , r^  - 1 

and 


(14')  Pr(r  = r„|©)  = 1 - ’z  Pr(r  = k(e), 

k = O 
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Further  one  has 


(15)  Eg(T)  = Z Pr(r  = k|6)  Ee(Xj^^^) 

Iv  — 1 


v/here  EQ(Xj,  can  be  found  from  (11 ),  and 


i'o  -1 


(16)  L(©)  = Z " Pr(r  = k ( e). 

k = O 


In  the  replacement  case  the  probability  distribution 


ox  1'  13  fTiven  O’' 


(17 ) Pr(r  = k | e)  = p(k;  X g)»  k = 0,  1,  2, . . . , r 


^•o 


(17* ) Pr (r  = r ) 0)  = 1 - Z 


p(k;  Xa)' 


In  (17)  ind  (17’).  Aq  = and  p(k:  A©) 

= ^ exp  - ( Ae)/k;. 


Further  one  hn.s 


^o  -2 


(18)  E_(r)  = Xfi  2 p(k;Xe)  + 


k = 0 


r -o 

1 - z 

k = 0 


P(k;  Aa) 


(19)  Ee(T)  = eE^(r)/n 


r - 1 

o 


(20)  L(e)  = Z p(k;X0)- 

k = 0 


We  have  jjust  given  formulae  for  the  0.  C.  curve,  the 
expected  waiting  time,  and  expected  number  of  items  failed 
in  the  course  of  reaching  a decision  for  any  preassigned 
n,  Tq,  i’q.  We  now  give  a formula  for  finding  the  appro- 
priate truncated  test  (that  is,  for  finding  r^  and  n)  when 
the  truncation  time  is  preassigned  and  the  0,  C.  curve 
is  required  (for  pi-eassigned  type  I error,  ^ , and  type  II 
error,  ^ ) to  be  such  that  Lveo)=l  -ot  and  L(0i)$(5.  It  is  proved 
the  paper  referred  to  in  the  farst  paragraph  of  this  section 
that  for  both  the  replacement  case  and  the  non-replacement 
case  the  appropriate  Tq  is  precisely  the  same  as  the  r^  used 
in  tests  of  the  form  (9)-  Hence  Table  1 can  be  used.  As  for 
the  appropriate  value  of  n one  should  choose 


where  [^xj  means  the  greatest  integer  ^ x,  in  the  replacement 


case . 


In  the  non-replacement  situation  a good 
approximate  value  of  n,  in  case  ©q/'^o  substantially 
more  than  one  (say  ^3),  is  given  by 


where 


n = 


IV.  Sequential  Life  Tests 

One  can  maT;e  substantial  improvements  on  the  procedures 
described  in  sections  II  and  III  by  following  a sequential 
procedure.  It  is  shown  in  a paper  by  Epstein  and  Sobel  (see 
ref. (5))  that  the  sequential  probability  ratio  test  of  A. 

Wald  can  be  applied  to  liTe  testing.  It  is  very  interesting 
that  decisions  can  now  be  made  continuously  in  time.  At  each 
moment  t,  one  can  decide  either  to  accept,  to  reject,  or  to 
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continue  the  life  test.  If  v/e  are,  as  before,  testing 

0 = 0Q  against  : © = 0^^  (©^  > ©^^ ) with  Type  I error 

and  Type  II  error  = (3  , then  the  decision  as  tine  unfolds 
depends  on 

(23)  B < (00/01 exp  - ^ (l/©i  - l/©^)V(t)|  < A 

where  A and  B can  for  all  practical  purposes  be  taken  as 


A = (1  - P )/k 


B = ^1  - OC  ). 


In  (23),  r is  the  number  of  failures  observed  by  time  t. 

The  decision  to  continue  experimentation  is  made  as  long 
as  the  inequality  (23)  holds.  As  soon  as  (23)  is  violated, 
one  accepts  IIq  the  function  of  t in  (23)  is  < (3,  and  one 

rejects  Hq  (accepts  Hi)  if  the  function  of  t in  (23)  is  ^ A, 

In  (23)  V(t)  is  a statistic  v/hich  equals  the  total 
number  of  hours  lived  by  all  items,  failed  and  unfa.iled, 
up  to  time  t.  In  the  replacement  case 


(25)  V(t)  = nt, 

while  in  the  non-replacement  case^^) 


(26)  V(t)  = S (n  - i + 1)  (Xj^  - + (n  - 


O (t  - x^) 


= Z Xj^  + (n  - r)  (t  - X ), 
i=l  ^ 

It  is  convenient  to  v/rite  (23)  as 


(27)  -h^  + rsCV(t)  < h^  + rs, 

whore  h^,  h^ , and  s are  positive  constants  given  by 

/^o  ^ 1.  “ ioS  B ^ _ log  A log  (0...y0i  ) 

(^8)  "o  = TTe— T79„  ■ '■1  - ue,  ? i/9„  ■ = = 

’^'’Jlt  Should  be  remarked  that  in  the  non-roplacemsnt  case  a 
special  problem  arises  if  all  n items  fail  without  reaching  a 
decision.  This  eventually  can  be  taken  care  of  in  ^'arious  .vays , 
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It  is  shown  in  our  paper  referred  to  in  the  first  paragraph 
how  foj’ravila  (27 ) enables  one  to  carry  out  the  sequential 
procedure  graphically. 


The  O.  C.  curve,  that  is,  the  probability  of  accepting 
Hq  when  9 is  the  time  parameter  value,  is  given  approxi- 
mately by  a pair  of  parametric  equations 


(29) 


L(e) 


9 


h(l/0^  - 


- 1 
1/00 ) 


} 


by  letting  the  parameter  h run  through  all  real  values. 

The  values  of  L(9)  at  the  five  points  9=0,  0^,  s, 

0Q,  enable  one  to  sketch  the  entire  curve.  These  values 
are  respectively  0,  ^ , log  A/ (log  A - log  B),  1 - PC  , and  1. 

Eg  (r),  the  expected  number  of  observations  required 
to  reach  a decision  when  0 is  the  imean  life  is  given  by 

, 6 ^ s 


(30) 


Ee(r) 


If  v/e  let  k = 0Qy0^ , the  approximate  values  of  ^^(r) 
become  particularly  simple  when  0 = 0-](  , s,  or  0^.  Tho3'  are 

(51)  Eq^  (r)  -^[j^log  B + (1  -(3)  log  Aj/flog  k - (k  - i)/kj 
Es(^)^  — iog  A log  B / (log  k)2, 

Eq  (r)^[^(l  -e<.)  log  B + «<•  log  Aj^^^log  k - (k  - 1 )J  • 


In  Table  5,  we  give  Eq  (r)  for  five  values  of  0 
(0,  0^,  S)  ©o>  •*  ) values  of  k(5/2,  2,  5/2,  3), 

and  for  the  four  number  pairs  ( oC  , ^ ) which  can  be  made 

with  the  numbers  .01  and  ,05- 


4o 


1 


L 


It  can  be  shown  that  Ee(t),  the  expected  waiting  time 
to  reach  a decision  is  given  by  the  formula 


(32)  Ee(t)  = Ee(r)  e/n 

in  the  replacement  case.  In  the  non-replacement  case, 


(33)  Ee(t)  = Z Pr(r  = k|e)  iXl,  J 

k=l  ’ 

where  Eq  ( ^)  can  be  found  from  (11 ).  A good  approxi- 

mation for  E (t)  is  given  by 
0 


( 34  ) E ( t ) ^ e log 
0 


( n - Eq  (r)  } 


The  derivations  of  all  formulae  in  this  section  can 
be  found  in  the  reference  cited  in  the  first  paragraph. 

V.  Conclusion 

We  have  not  attempted  in  this  paper  to  cover  all  of  the 
papers  which  have  been  published  by  a number  of  writers  in- 
cluding the  author  in  the  field  of  life  testing.  We  have 
selected  essentirily  three  papers  (see  ref.  (3)»(4),(5)) 
which  give  some  of  the  results  v/hich  wo  consider  to  be  most 
fundamental.  A careful  reading  of  these  papers  give  a good 
introduction  to  the  statistical  methodology  involved  in  life 
testing.  These  papers  also  contain  many  numerical  illustra- 
tions which  v/ill  be  of  substantial  help  in  seeing  how  one 
applies  the  theory  Id  the  design  and  analysis  of  life  tests. 
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Table  1 


Values  of  r (upper  numbers)  and  of  ^ (2r)/2  (lower  numbers) 

A ^ Y 2 

such  that  the  test  based  on  using  Qr,n  A.  (2r)/2r 

as  acceptance  region  for  0 = 0^  will  have  L(0q)  = 1 -ocand  , 


00/^1 

oC  = .01 

P< 

LTl 

0 

II 

c> 

(.=  .10 

P=  .01 

.05 

(3  = .10 

^=.01 

^ = .01 

II 

^=.10 

3/2 

136 

101 

83 

O'” 

67 

55 

77 

52 

4i 

110.4 

79.1 

63.3 

79.6 

54.1 

43.4 

66.0 

43.0 

33.0 

2 

46 

35 

30 

33 

23 

19 

26 

18 

15 

31.7 

22.7 

18.7 

24.2 

15.7 

12.4 

19.7 

12.8 

10.3 

5/2 

27 

21 

18 

19 

14 

11 

15 

11 

9 

16.4 

11.8 

9.62 

12.4 

8.46 

6.17 

10.3 

7.02 

5.43 

3 

19 

15 

13 

13 

10 

8 

11 

8 

6 

10.3 

7.48 

6.10 

7.69 

5.43 

3.98 

7.02 

4.66 

3.15 

4 

12 

10 

9 

9 

7 

6 

7 

5 

4 

5.^3 

4.15 

3.51 

4.70 

3.29 

2.61 

3.90 

2.43 

1.75 

5 

9 

8 

7 

7 

5 

4 

5 

4 

3 

3.51 

2.gi 

2.^ 

3.29 

1.97 

1.37 

2.43 

1.75 

1.10 

10 

5 

4 

4 

4 

3 

3 

3 

2 

2 

1.28 

.825 

.82: 

l.JT 

m 

.818 

1.10 

.552 

.532 
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Table  2 


I 


Ratio  of  the  Expected  Waiting  Time  to  Observe  the  r'th 
Failure  in  Samples  of  Size  n and  r respectiveTy 

E(X,  n)  / E(Xr,r)  = 


'np 

r 

1 

2 

3 

4 

5 

10 

15 

20 

1 

1 

.50 

.33 

.25 

.20 

.10 

.067 

.050 

2 

- 

1 

.56 

.39 

.30 

.14 

.092 

.068 

3 

- 

- 

1 

.59 

.18 

.12 

.087 

4 

- 

- 

- 

1 

.62 

.23 

.14 

.104 

5 

- 

- 

- 

- 

1 

.28 

.18 

.125 

10 

- 

- 

- 

- 

- 

1 

.35 

.23 

Table  3 

Approximate  values  of  EQ(r)  for  sequential  tests  for  various 
values  of  k = ^ * 
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0o/e 
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5/2 
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7 
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4 
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.05 

11 

7 

7 

4 

5 

3 

4 

3 

.01 

62.4 

40.3 
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15.1 

14.2 
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6.74 

.05 
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13.8 

8.38 

10.1 

6 . 14 

.01 

128 

82.7 

43.9 

28.3 

25.1 

16.2 
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11.3 

.05 

82.7 

52.7 

28.3 

18.0 

16.2 

10.3 

11.3 

7.18 

©r 

.01 

47.6 

44.2 

14.7 

13.6 

7.71 

7.16 

5.00 

4.63 

c 

.05 

30.8 

28.0 

9.48 

8.64 

4.99 
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ANALYSTS  0?  VARIANCE  MO^^ELS  WITR  ETTII'^ESRI  APPLICATIONS 

Py  !'ary  D„  lum 

Wrij^ht  Air  Development  Cc/iter 


I , PURPOSE 


As  the  title  indicates,  I am  going  to  discuss  "Analysis 
of  Variance  flodels  with  Engineering  Applications’’.  There  are 
t’.vo  main  points  which  I propose  to  cover.  The  first  i.s  to 
emphasize  to  you  the  difference  between  fixed  and  random 
factors  in  an  experiment,  and  their  influence  upon  statistical 
tests  and  inferences. 

"'he  second  main  point  is  to  describe  (by  means  of  examples) 
an  analysis  of  variance  model  more  general  than  the  factorial 
or  pvire  hierarchal  types.  It  is  a type  of  nesting  design, 
which  I shall  call  "partially  hierarchal". 

For  those  of  you  who  are  interested  in  obtaining  references 
to  the  Analysis  of  Variance  procedure  and  its  applications, 
here  are  a few  reports  which  would  make  a good  start  on  the 
sub-*  ect : 

(1)  WADC  TR  55-20,  "An  Elementary  Approach  to  the  Analysis 
o?  Variance"  by  Rider,  Tiarter,  and  Lum,  A3TIA  No.  AD9339^. 
(Contains  a large  bibliography  to  other  papers  and  books) 

(2)  WA^C  TR  55-33  "Partially  Uierarchal  Nodels  in  the 
Analysis  of  Variance"  by  I'arter  and  Lum.  ASTIA  No.  AD754‘fO. 

(5)  'iVADC  TR  53-23  "Tests  by  the  Analysis  of  Variance" 
by  Nentzer.  ASTIA  No.  ADl402B 

(4)  Eisenhart  - The  assumptions  underlying  the  analysis 
of  variance.  biometrics  3,  (194’)  pp  1-21.  (Yodel  I, 

"odel  II). 

(5)  Cochran  - Some  consequences  when  the  assumutions 
for  the  analysis  of  variance  are  not  satisfied.  Biometrics 
3 (194V)  pp  22-3*^. 

I will  define  FACTOR^,  as  a suspected  source  or  cause  of 
vai’lation  taken  into  account  by  the  experiment,  I.EVEL  as  one 

^"here  are  two  types  of  factors: 
fl)  "main"  factors 

(2)  Interactions  of  two  or  more  "main"  factors 
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conditicn  of  a factor,  and  EFFECT  as  a numorioal  value 
associated  with  a level  of  a factor.  A fixed  factor  (F)  is 
distinguishable  where  the  levels  of  F constitute  a 
population  and  a random  factor  (f)  is  distinguishable  where 
levels  of  f represent  a random  sample  from  an  infinite 
population  of  such  levels. 

With  regard  to  the  first  point  (on  the  differentiation 
between  fixed  and  random  factors ) it  is  possible  on 
occasion  to  arrive  at  essentially  the  same  statistical 
result  regardless  of  whether  the  factor  is  fixed  or  random. 
However,  in  general  this  is  not  the  case.  To  emphasize  this 
point,  I am  going  to  present  an  experiment  in  which  "different” 
answers  are  obtained  depending  on  the  type  of  factor-fixed  or 
random.  If  you  are  making  Inferences  about  a particular 
set  of  experimental  levels  (fixed  factor)  in  general  you 
make  different  statistical  teats  than  if  you  wish  to 
generalize  by  making  Inferences  about  an  infinite  population 
from  which  your  experimental  levels  were  assumed  to  be 
chosen  at  random  (random  factor).  The  statistical  conclusions 
based  on  these  tests  may  then  be  "different",  in  a narrow 
sense.  Taken  from  a broader  viewpoint  they  are  really  just 
different  aspects  or  facets  of  the  same  physical  situation 
and  when  used  properly  do  not  lead  to  inconsistent  results. 

Misinterpretation  of  this  difference  between  fixed  and 
random  factors  has  led  to  misunderstandings  between 
statisticians  and  subject  matter  specialists,  such  as  the 
engineer  or  chemist.  In  fact  this  could  very  well  be  one 
more  of  those  touchy  points  which  have  given  credence  to 
such  disparaging  remarks  as  "there  are  liars,  damned  liars, 
and  then  statisticians".  Furthennore , there  are  those 
unacquainted  with  statistical  methods  (mathematicians 
included)  who  believe  the  statistician  must  be  akin  to 
a magician,  for  he  seems  utterly  capable  of  drawing  any 
conclusions  he  wants  from  a given  set  of  data.  From  a 
superficial  point  of  view  this  is  partly  right.  It  is 
possible  to  draw  different  statistical  conclusions  from 
the  same  set  of  data  depending  on  the  particular  statistical 
tests  made.  However,  if  one  delves  further  into  a more 
serious  consideration  of  the  nature  of  the  data,  how  they 
were  obtained,  what  Inferences  are  possible,  and  what 
questions  one  desires  to  answer,  one  finds  that  the 
statistical  tests  to  be  made  depend  uniquely  on  these 
considerations . 
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If  you  take  in  some  regular  manner  a set  of  levels  of  a 
factor  (e.g.  temperature  at  25°C,  50°C,  75°C,  100°C)  for 
an  experiment  and  can  NOT  by  any  stretch  of  the  imagination 
even  remotely  regard  it  as  a random  sample  from  scmie 
infinite  population  then  naturally  it  does  not  make  sense 
to  consider  it  a random  factor.  It  is  ipso  facto  a fixed 
factor.  On  the  other  hand,  experimental  units  (considered 
as  levels  of  a factor)  while  not  necessarily  chosen  randomly 
(in  the  statistical  sense)  may  be  picked  in  a haphazard 
manner.  If  they  exhibit  no  evidence  of  any  regular  pattern 
of  relationship  to  one  another,  then  there  is  little 
argument  against  considering  them  to  be  levels  of  a random 
factor  in  order  to  enable  one  to  generalize.  However,  one 
must  be  extremely  careful  concerning  the  type  of  population 
to  which  one  is  generalizing. 

Thus  whether  considering  a factor  fixed  has  more  meaning 
than  considering  it  random,  or  vice  versa  depends  on  (1) 
what  type  of  statistical  inference  you  wish  to  make  and  (2) 
how  the  data  are  taken  (this  constrains  the  type  of  inference 
you  are  allowed  to  make). 

II.  BACKGROUND 

For  the  benefit  of  those  who  are  not  acquainted  with  it, 

I would  like  to  backtrack  a little  to  give  a definition  and 
a brief  elementary  description  of  what  the  analysis  of 
variance  procedure  is.  The  analysis  of  variance  is  a 
statistical  technique  which  separates  the  total  variance  in 
a set  of  data  into  parts,  each  representing  a linear 
combination  of  the  variances  of  different  factors.  A des- 
cription of  the  significance  of  the  factor  F is  depicted 
as  follows: 

Let  A estimate  a linear  combination  of  variances  which 
includes  the  variance  of  F 

Let  B estimate  the  same  linear  combination  (as  estimated 
by  A)  with  the  deletion  of  the  term  involving  the 
variance  of  F. 


If  A»B,  i.e.  if  F>F^^1 

then  the  factor  F is  "significant"  at  theeClevel. 
(Equivalently,  the  set  of  effects  corresponding  to  the  levels 
of  F can  be  said  to  "vary  significantly"  at  the «C  level) 
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If  A is  of  sufficiently  greater  magnitude  than  B,  then 
one  can  conclude  that  the  factor  under  consideration  has 
contributed  significantly  to  the  variation.  Thus,  in  this 
manner  the  Analysis  of  Variance  facilitates  determining 
whether  the  factor  under  consideration  has  significantly 
influencea  the  variation  in  the  data. 

What  the  linear  combinations  consist  oC  will  depend 
on  whether  the  factors  are  fixed  or  random.  The  linear 
combinations  in  turn  determine  what  F- tests  are  to  be  made. 

Now  consider  the  following  experiment  on  Human 
Engineering.  The  experiment  was  performed  by  the 
Acceleration  Section,  Biophysics  Branch  of  the  Aero  Medical 
Laboratory  at  Wright  Air  Development  Center. 

III.  CE^rTRIFUGE  EXPERIMENT 

The  purpose  was  to  compare  the  effects  of  a protected 
condition  f pressure  suit  inflated)  vs  an  unprotected 
condition  (pressure  suit  deflated)  on  human  performance  in 
tracking  a target  while  subjected  to  a 5g  force.  A 
measure  of  performance  is  the  time  on  target.  The  inflated 
pressure  consisted  of  an  additional  1-1/2  to  2 Ibs/sq.  in. 
applied  at  abdomen,  thighs  and  calves  of  legs  for  maintaining 
better  equilibrium.  The  experiment  was  performed  in  a 
centrifuge . 

Sources  of  Variation 

Other  main  factors  that  were  suspected  of  affecting  the 
test  results  were: 

(l)  Acceleration  conditions  (A):  Control  1,  (Standing 
still).  Transition  1,  5G,  Transition  2,  Control  2,  (standing 
still). 


A = fixed  factor 


Rest  Period: 

5 minutes 
between  runs 


1 


The  transition  data  have  not  been  analyzed. 


(2)  Amount  of  Learning:  Fatigue 

In  order  to  evaluate  this  effect,  10  runs  were 
made  with  3 minute  rests  in  between,  A physiologist  who 
consulted  on  this  problem  considered  this  a sufficient  rest 
period  for  the  human  body  to  return  to  nonnal  activity 
(runs  considered  random). 

(3)  Personal  reaction  to  the  stress  (Subjective 
feeling)  individual  effect.  (S) 
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The  group  of  6 subjects  consisted  of  volunteers.  It 
will  develop  later  that  the  experience  of  the  subjects  had 
an  important  effect  on  the  test  results.  The  group 
consisted  of  the  following: 

Rank  of 

Experience  Code  letter  Subjects 


3 

1 

5 

4 

6 
2 


M 

E 

Sa 

L 

Si 

B 


Airman,  maintenance 
Physiologist,  rated  pilot 
Medical  Doctor 
Physiologist 
Psychiatrist 
Sergeant,  maintenance 


All  the  subjects  in  the  experiment  were  of  medium  build, 
(obese  people  make  poor  subjects  as  they  may  black  out 
sooner ) 

Forces  to  be  considered  are: 


fl)  Positive  g (Blackout)  from  head  to  toe 

(2)  Negative  g (Redout)  from  toe  to  head 

(3)  Transverse  (tangential  or  centripetal)  — from  chest 

to  back 


Because  of  the  nature  of  the  centrifuge  and  the  extremely 
short  duration  under  stress,  forces  (2)  and  (3)  may  be 
neglected.  Thus  the  only  effective  force  under  consideration 
is  the  "positive"  3g  force.  Main  factors  and  their  types 
in  the  centrifuge  experiment  are  as  follows: 


Main  Factors 

Protection 

Acceleration 

Subjects 

Runs 


Type  Levels 

Fixed  with,  without  (2) 

Fixed  Control  1,  3g,  Control  2(3) 

Fixed  or  Random  , S2  f ...,  Sg  (6) 

Riindom  > •••» 
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Description  of  the  Experiment 


Subject  donned  G-suit  and  was  prepared  for  bioelectric 
measurements.  Subject  then  sat  in  a prototype  of  a pilot's 
seat  located  inside  an  enclosed  cabin.  This  cabin  is  at 
one  end  of  a long  arm,  the  other  end  being  fixed  (the 
centrifuge).  About  three  feet  in  front  of  him  at  eye-level 
are  located  two  ammeters , each  about  4 inches  in  diameter 
with  2 sine  slow  wave  oscillators  (approximately  .05  cycles/ 
sec)  driving  the  two  needles.  The  oscillators  are  at 
slightly^  different  frequencies  in  order  to  keep  the  needles 
from  crossing  the  same  point  at  the  same  time. 


2 Ammeters  (in  milliamperes ) 

The  pointers  are  hinged  as  illustrated  and  move  on 
scales  marked  from  -100  to  +100  (a  radial  distance  of 
+ 1 inch).  A stick  simulating  the  pilot's  control  stick 
Ts  located  directly  in  front  of  the  subject  and  between 
his  legs.  Movement  of  the  stick  controls  the  movements 
of  the  two  pointers.  The  task  assigned  to  the  subject  is 
to  keep  both  pointers  on  a spot  corresponding  to  the  center 
of  the  dials  by  movement  of  his  stick.  The  two  pointers 
are  actuated  away  from  this  point  by  electrical  means. 

The  subject  is  considered  to  be  "on  target"  if  neither 
pointer  is  more  than  + 25  units  away  from  the  center  spot 
(about  1/4").  An  oscillograph  attached  to  a pen  writeout 
records  his  performance.  If  the  pointers  are  within  + 25 
units,  i.e.  "on  target",  the  pen  writes  a straight  line; 
if  tlie  pointers  are  not  within  this  limit,  "not  on  target", 
a 60  cycle  frequency  is  actuated: 


The  subject  had  two  trials,  one  for  each  pressure  con- 
dition. A trial  consisted  of  10  runs,  each  run  being 
performed  as  I described  before.  At  the  3G  condition  the 
centrifuge  is  rotating  at  such  a speed  as  to  produce  a 
centrifugal  force  equivalent  to  5G,  (96.6  ft/sec^)  on 

the  subject. 

It  was  assumed  that  the  order  of  presentation  of  the 
pressure  conditions  made  no  difference  on  the  performance 
In  a trial.  However,  as  an  extra  precaution  the  order  of 
presentation  was  randomly  selected.  Some  subjects  performed 
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first  with  the  pressure  "on";  others  performed  first  with  the 
pressure  "off".  Between  one  and  three  weeks  elapsed  between 
the  first  trial  and  the  second. 

A mathematical  model  for  this  experiment  is  given  by  the 
following: 


FACTORS 


Protection  (f) 

PA 

Acceleration  (f) 

PS 

Subjects  (f  or  r) 

AS 

Runs  within  PAS  (r) 

PAS 

f=Fixed) 
r=random ) 


MATHEMATICAL  MODEL 


Time  on  target  = M+P.+A  .+S, +(PA) . . + (PS)i, 

1 j k ' ' 'Ik 

+ (AS)  +(PAS) . +r.  , 

jk  ijk  ijkl 

ASSUMPTIONS 

M = constant 

Pj  = -Pg  = constant;  A]^ , A^,  A^  are  constants  Z Aj 

(PA)..  are  constants,  ? (PA)..  = £(PA)..  = 0 

i ij 

^•ijkl  - « (O’  •^r'l 
If  S - FIXED 

Sj^  are  constants,  g Sj^  = 0 

(PS)^j,^  are  constants,  ^ 

(AS)jjj  are  constants,  2(AS)jjj  = 2(AS)jj^  = 0 
(PAS)^jj^  are  constants,  ^(PAS)^^^  = ^(^^®)ijk 

= 2(PAS)ijj,  = 0 


= 0 
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If  S = RANDOM 


Ps' 


(As)  .j^  = N(o,  a^g);  (PAs)i^  = N(o,  aj^g ) 
(Ps). 


jk 

(AS)jj^,  (PAs)^^j^  are  uncorrelated. 


Define  efiect  y and  its  interactions: 


k ” 

®k  (^®).k  + 

(As)_k  + (PAs)_ 

^^Y^ik 

= L(ps)ik  ■ 

).J  H.  [(PAS)^.^  - 

(PAs)..jJ, 

?(Py)ik  = 0 

(Ar)jk  ^ 

= Q^®)jk " 

).J+  C(“A).Jk  - 

(PAs)_  k]. 

J(Ay).,  = 0 

(PAy)  . 

Ik  = - 

(PAs)j.k  - (PAs). 

jk  + (PAs)_ 

f (PAyjijk  - 

J(PA^)l,k  ■ 0 

Time  on 

Target  = M + P 

1 + Aj  +^k  (PA) 

i.j  (Py)ik 

+ (Ay)jj^  -H  (PAy)ijj^  + 


The  corresponding  Analysis  of  Variance  table  for  the 
above  model  with  S = random  is  given  by  Exhibit  1.  Exhibit 
2 indicates  the  contrast  in  the  numerical  results  for 
S = fixed  and  the  results  for  S = random. 


EXHIBIT  1 


SV 

P 

A 

r 

PA 

Py 


ANOVA  SUBJECTS  RANDOM  (RUNS  RANDOM) 


DF 

1 

2 

5 

2 

5 


60 


SQUARES 

ET 

) dpy 
'>  % 

+a‘^ 

V 

o 

Py 

Ay 

+a2 

r 

+10(i)(^) 

2 

2 

'^PAy 

2 

PA 

+ Oj. 

r 
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EXHIBIT  1 (cont.  ) 


'’I 


I 

1 


f 


t 


sv 

DF 

EX 

PECTED  MEAi:  3QUARES 

ET 

Ay 

10 

, 2 

+a  r 

2 

+a  r 

r 

> 

■< 

10 

10{j  ) (|)‘^pAy 

r|  PAs 

324 

+cr^ 

359 

r 

EXHIBIT  2 

ANALYSIS  OF  VARIANCE 

SV 

DF 

33 

H3  F(3  Fixed) 

F(3  Random) 

P 

1 

1^76.90 

V?76.90  57.01’*'* 

3.41 

A 

2 

1^48.69 

574.35  17.45** 

13.01*  * 

s,r 

5 

7,938.99 

1^87.80  48.23** 

48.23  * 

PA 

2 

225.87 

112.94  3.43* 

2.86 

ps,pr 

5 

^53.63 

550.73  16.73** 

i6.73‘*'* 

AS, AT 

10 

441.41 

44.14  1.34 

1.3^ 

PAS,PAr  10 

395.10 

39.51  1.20 

1.20 

rj  PAS 

324 

10^65. 40 

32.92 

— 

Total 

359 

2^445.99 

Using  the  Newman-Keuls  Multiple  Comparisons  Test  and 
Satterthwaitefe  approximation  for  chi-square,  one  obtains 
the  statistical  results  of  the  experimental  data  given  in 
Exhibits  3 through  13. 

EXHIBIT  3 


'=  32.92 


95%C0?TFIDENCE  LIMITS 


FOR  a' 


z 


i^}-025 
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EXHIBIT  3 (cont J 

(^).975 


= 1.10 


025 


= 0.912 


29.95  ^ 56.10 

5.5  < cj^<  6.0 


EXHIBIT  4 


Protected  = 20.79 
Unprotected  = 16.22 


MAIN  EFFECTS  OF  P 

* 


Pi  = 2,28 
Pg  = -2.28. 


P2<  Pi 


(S  FIXED) 

Pr  (3.56<P;,_  - P2<5.76)  = .95 


P-,  P,  (S  RANDOM) 
4-2 h 


Pr  (-0.50<P^  - p2<9.^^)  = .95' 
■^^Grand  Mean  = I8 . 51 
EXHIBIT  5 

MAIN  EFFECTS  OF  A 


Control 

1 = 20.82 

/Aj  =2.51 

5G 

= 16.47 

[ A^  =-2.04 

Control 

2 = 18.25 

\ A,  =-0.28 

5G  C2 

4 

21 


G<  C^c.  C,  (S  FIXED)  / 

^ 1 y Newman -Keu Is  Test 

G,  C_<  Cl  (S  RANDOM)  / 

I ^ 

Grand  Mean  = I8.5I 
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EXHIBIT  6 


12 


MAIN  EFFECTS  OF  S (S  FIXED) 


= 27.87 

S^  = 12.48 

/ 9.36 

-6.03 

s 

2 

= 18.73 

s^  = 17.88 

5 

/ 0.22 

-0.63 

=3 

= 15.68 

s,  = 18.38 

6 

1-2.83 

-0.13 

44 

H-42 

^ 

l6 


18  19 


28 


^4^  ^6>.^2i^^l 

Grand  Mean  = I8.5I 

EXHIBIT  7 

APPROX  * 95%CONFIDENCE  LIMITS 
FOR  (S  RANDOM) 

y ^ MS(y)  - MS(r)  ^ 1587.80  - ^2.92  ^ 25  91 

60  60 


a2 


A2 

o5 


025 


/o 

V5  / .975 


= 2.57 


f) 


025 


= 0.166 


10  < a^<  156 

3.3  < o^<  12.5 

Using  Satterthwaite 's  Approximate  chi-square. 
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EXHIBIT  10 


1 


EFFECT  OF  PRESSURE  PROTECTION 


EXHIBIT  11 

APPROXIMATE  95  PERCENT  COITFIDENCE  LIMITS 
FOR  (S  RANDOM) 


A2  ^ 1 MS(Py)  - MS(r.)  ^ 1 550.73  - 32.92  = 8 63 

P/  2 30  2 50  ^ 


PE^CEhlT  Of  T/ME  ON  TMET 


EXHIBIT  12 


CONTROL  VS  ACCELERATION 


UMPROTBCUP  fRQTBC  TB  P 


zs 


EXHIBIT  1J> 


PA  INTERACTION 


. (PA) 

(Pi-P2)Ci  = 5.30 

/ 

0.37 

-0.37 

AG  = (Pj^-P2)G  = 6.03 

0.73 

-0.73 

ACg  = (P^-P2)C2  = 2.37 

V 

-1.10 

1.10 

. AC 

— ^ — 5 

h 

AC2<  AC^, 

AG 

1 

(S 

1 

FIXED) 

1 ^ > 

AG 

J 

RANDOM ) 

-p  =4.56 


¥ 
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PARTIALLY  IIIERARCHAL  MODELS 


I 


Tha  example  I have  just  finished  talkins  about  is  a factor_al 
model.  It  is  called  "mixed"  vhenever  some  of  the  factors  are 
fixed  and  some  random.  I will  now  take  up  the  second  main  po_nt, 
v/hicli  is  to  describe  what  a partially  hierarchal  model  is  and 
what  it  does.  It  is  a more  general  type  and  includes  the  factor- 
ial and  the  pure  hierarchal  model  as  special  cases.  The  term 
was  coined  by  Dr.  Harter,  my  colleague  at  the  Aeronautical 
Research  Laboratory,  and  I think  the  term  is  very  appi-opriate 
for  these  models.  Dr.  Harter  and  I investigated  these  models 
and  our  research  efforts  have  culminated  in  WADC  Technical  Re- 
port 55-33  titled  "Partially  TIiorarch.al  Models  in  the  Analysis 
of  Variance". 

In  our  report  we  give  tables  of  the  proper  error  terms  for 
F-tests  with  respect  to  partially  hierarchal  models  up  to  four 
factors.  It  is  also  indicated  how  to  extend  the  analysis  to 
n factors.  This  is  illustrated  in  Exhibit  l4. 


EXHIBIT  14 


FACTORIAL 


.t’ROTECTED 


Is 


1 -’2  "^5  "^4  '"*5 


^6 


ISTING  WITHIN  P 


PROTECTED 

f_j 

.S  1 

UNPROTECTED 

1 '*^2  'b 

, -^4  ^5 

UNPRCTECTEO 

'l  ^^2  ^3  ^4  ^5  ‘^6 

(a^) 


n 


T 53 ^ 1 

J '"’8  ^9  ""lO  11  '"^2 


Suppose 

oxpei’iment 


no, 7 that  2 groups  of  6 subjects  are 
The  first  group  of  6 subiects.  G- 


used  en  the 
performs  the 
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Thus  ouch  subject  no  lonf^er  occurs  vith  all  levels  o7  r ?.s 
in  a factorial  modal.  In  such  a situation , tha  sub.jacts 
factor  i.s  a nastin"  factor,  and  it  is  said  to  "nost  rithin 
tha  P factor".  This  can  also  ba  described  as  "subjects  within 
protection".  The  ma.in  char?.cteristic  of  tha  nesoins  is  that 
there  is  no  lonj^er  a direct  relationship  bet.veen  the  first 
(ith)  subject  -.vith  protection  and  the  first  (ith)  subject 
vithout  protection. 

definition:  A pure  hiorarchal  nodal  is  one  ..'here  all  the 

factors  form  a nested  set;  -.vheroas  a parti.allj'-  hiorarchal 
model  is  one  in  v.’hich  some  factors  e.re  of  the  riestin^^  type 
and  the  remaining  factors  are  factorial. 

Thus,  the  centrifuge  experiment  as  nov  altered  is  a 
partially  hiero.rchal  experiment  (instea.d  of  a factorial) 
where  the  Subjects  factor  is  nested  .vithiu  the  Protection 
f.actor.  A mathematical  model  for  this  pa'’tiall3'  hierarch?.! 
c?.se  is  given  in  Exhibit  15A  and  I5B  with  the  cor"’espendiag 
x\nal3''Gis  of  Varia,nce  table  given  in  Exhibit  16.  Exhibit  if 
shows  a co;npa.rison  of  the  ■''•alues  of  F for  the  factorie.l  model 
(tahen  from  Exhibit  2}  and  the  value.s  of  F for  the  pa.rtiall3/ 
hierarchal  model  (using  the  same  data  ?,s  if  it  oi’iginated 
from  the  pe.rtiallj'’  hierarchal  situation). 


EXHIBIT  I5A 

MATTIETIATICAL  MODEL  FOR  S (RANDOM)  NESTING  IN  P 

Time  on  Ta,rget  = M + P.  + A.  + s., 

^ 1 .1  ik 

+ (PA ) . . + (As  )^  . , + r . , 

ijkl 


= constant 


= - P2  = cons  tan  b 


c^ , 35,  Cg  are  constants,  Z A^  = O 

(PA). . aro  constants,  Z(PA).  = O = Z(rA) 

i 1.1  j : 

"^ik  = ‘^As):  ^ijkl=‘’^®> 

s.,  , (As).  , r.  . n.re  mutu?.lly  uncorrola.to 

lx  ijX  ijlii 


• n 


I 
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EXHIBIT  15B 


1 


DEFINITION  OF  EFFECT 
AND  CORRESPONDING  INTERACTIONS 

^ik  = ®ik  k 

(Air)ijk  = (As)^jj^-(As)^^^,  Z (AjOijk  = 0 

Time  on  Target  = M + -f  A . + 

3 

+ (PA)ij  + (A/')ijjj  + ’^ijkl 


EXHIBIT  16 


ANOVA  PARTIALLY  HIERARCIIAL 
S( RANDOM)  NESTING  IN  P 


sv 

DF 

EXPECTED 

MEAN 

SQUARE 

ET 

p 

1 

180(|)  a 

2 + 

P 

50 

+02 

r 

r 

A 

2 

120(|)  a 

2 

A 

+ 10  (|)  cl|^ 

+0^ 

r 

Ay 

f|p 

10 

50 

+0^ 

r 

r 

PA 

2 

60(|)(f 

)”PA 

+02 

r 

Ay 

Ar|p 

20 

io(|)4^ 

+02 

r 

r 

r]  PAs 

524 

02 



Total 

355 

r 

I 


6o 


li 


« 

-f  >• 


if  k 


EXHIBIT  17 


SV 

P 

A 

s/p 

r 

(p  s 
PA 

As/P 
J^As 
/ PAn 


ANOVA  S NESTING  IN  P 


DF 

1 

2 

10 

{; 

2 

20 


10 

10 


r/PAs 

Total 


324 

35^ 


ss 

MS 

F^ 

F^ 

1877 

1877 

1.75 

3.41 

1149 

574 

13.73^^ 

13.01’^* 

10,693 

1069 

32. 48="^ 

1939 

1588 

(48.23^'*^ 

/ 2754 

i 

551 

(16.73^*' 

226 

113 

2.70 

2.86 

837 

41. 

8 

1.27 

1 

r44l 

A4.1 

(1.34 

i 

[395 

(39.5 

\l.20 

10,665 

32.9 

_ _ 

— 

25,44fe' 


1 Partiallj'  Hierai'chal 

2 Factorial 


Possible  advantages  of  usinfj  a partiallj^  hierarchal 
medal  (and  an  experiment  based  on  it)  are: 

(1)  it  is  often  easier  to  obtain  a large  number  of 
sub.jacts  for  short  periods  of  timej 

(2)  learning  or  fatigue  effects,  if  they  are  important, 
are  avoided. 

Hidden  Pitfalls  in  such  a model  are: 


(Error  1) 

Pi 

P2 

If: 

15 

1 

1 

15 

(Gl«  G2) 

Conclusion : 

Get  no 

sig. 

P effect 

(Subject  group  1 « Subject  group  2) 
6l 


(Error  2) 


Conclusion:  Get  sig.  , 

1 (pj  = pg)  when  actuallj'  P^  = Pj^ 

15  (Gi«  Gg)  (Gj  « Gp) 

TE 


(Error  3) 


1 Pj  > Pg  Conclusion:  get  Pj^  < Pp 

15  G « G„  when  actually  P,  > P,^ 
[F  ^ 

(G^  « Gp) 


(Error  4)  Even  if  Gj  and  G2  differ  in  same  direction  as 
and  Pg , conclusion  may  not  be  quite  rifjht. 


If:  P-, 


Conclusion:  G^^  » Gp  inflates 


i j.  ♦ vj  ^ '^Q  a.  A ^ ij 

• ® • » 15  1 p >;>  p ^ 

I 2 (or  deflates  as  the  case  may 

2Q  1 G » G difference  between 

35  ^ ^ ^2- 


P2  and  Pp • 


One  method  to  insure  against  these  errors  if  possible  is 
to  pre-test  the  subjects  for  assurance  that  the  tv/o  groups 
are  essentially  alike. 

Another  example  of  a partially  hierarchal  model  is  an 
experiment  being  conducted  by  the  Metals  Branch,  Materials 
Laboratory,  at  Wright  Air  Development  Center,  The  experiment 
was  to  be  performed  to  evaluate  the  mill  production  quality 
•,vith  respect  to  uniformity  of  roll  sheets  of  metal. 

The  purpose  was  to  make  inferences  concerning  the  uniform- 
ity of  rolls  v/ith  respect  so  some  measured  ch.aracteristic  in 
the  metal. 

The  following  diagram  indicates  the  manner  in  which  the 
measurements  were  made. 


(3  batches) 

0 0 0 

heIt 

(BATCH) 

6 shoots 
at  random 


Samples  were  taken  from  perimeter  of 
sheet  since  it  was  desired  to  preserve 
the  sheet  for  further  use.) 

SHEET 


3'x6’ 

SAMPLE 


LOCATION, 


(Sample  at  random) 
SAMPLE 


0 0 0 


2 nooasurements 


3 Locations:  edge,  center, edge 


I 


Total  number  of  measurements  =3X6X3X2=  108 

A mathematical  model  for  this  partially  heierarchal 
experiment  is  given  in  Exhibit  l8  and  19  with  the  corres- 
ponding Analysis  of  Variance  table  given  in  Exhibit  20. 

EXHIBIT  l8 

METALS  EXPERIMENT 

H = Heat (Batch)  S = Sheet  - Sample 

L = Location  M = Measurement 

H 
S|  H 
L 

mIlsh 


(random) 

nesting  in  H (random) 

factorial  (fixed) 

nesting  in  L,  S (random) 


! 

1 

ft 

1 


i 


i 


EXHIBIT  19A 

MATHEMATICAL  MODEL  FOR  PARTIALLY  HIERARCHAL 
^ijkr  = M + hi  + s^j  + Lj^  + (hL).j^  + (sL)^^^^  + 

Lj^ , L2,  ^3  ” constants,  ^ = 0 

h.  = N(0,  a2);  sij  = N(0,  0^);  (hL)ik  = N(0,  ag^^) 

(sL)ijk  = N(0,  a2^);  mijkr  = ^(O, 

Sij,  (hL)ijj,  (sL)ijj^,  rajjkr  are  mutually  uncorrelated. 

^®ij  = = (sL)jj^  + (hsL)iji, 


i 
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EXHIBIT  19B 


DEFINITION  OF  EFFECTS  <1,^ 
AND  CORRESPONDING  INTERACTIONS 

a.  = + (hL)i.  , = s^.  + (sL)ij^ 

(i*L).j^  = (hL)ii^  - (hL)i.  , I (flL)iij  = 0 

(pL)ijk  = («L)ijk  - , 2 (PL),  = O 

^i.ikr  = M ‘‘i  ^13  + + ((3L),.i^  + 


EXHIBIT  20 

ANOVA  PARTIALLY  HIERARCHAL  MODEL 
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Questions  that  can  be  answered  by  use  of  this  partially 
hierarchal  model: 


1.  Do  batches  differ  significantly  as  compared  with  variations 
in  sheets  v/ithin  a given  batch? 

2.  For  a given  batch  do  sheets  differ  significantly  as  compared 
with  variations  in  measur^ements? 

5.  Do  locations  show  a significant  difference  as  compared  to 
the  variation  in  location  differences  from  batch  to  batch? 

4.  Do  the  variations  in  location  differences  from  batch  to 
batch  differ  significantly  as  compared  to  the  variations  in 
location  differences  from  sheet  to  sheet  within  a batch? 

5.  Are  variations  in  location  differences  from  sheet  to  sheet 
within  a batch  significantly  different  or  can  they  be  attribu- 
ted to  the  errors  in  measurement? 
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TWO-SIDED  TOLERANCE  LIMITS  FOR  NORMAL 
DISTRIBUTIONS  USING  THE  RANGE* 

By  George  J.  Resnikoff 


f 


» 


INTRODUCTION 


The  quality  of  manufactured  product  is  often  specified 
by  giving  a range  or  interval  for  a measureable  characteristic. 
The  upper  and  lower  limits  to  this  interval  are  called 
tolerance  limits.  These  limits  are  such  that  the  probability 
is  equal  to  a preassigned  value  that  the  interval  includes 
at  least  a specified  proportion  of  the  statistical  universe. 

The  problem  of  compvxting  two-sided  tolerance  limits 
on  the  basis  of  a sample  is  as  follows: 

Let  X be  a random  variable,  with  distribution 
function  F,  and  let  x^ , x . xj^  be  a sample  of  N 

observations  on  x.  It  is'^required  to  construct  two  functions 
of  the  sample,  Lj^  and  Lg,  such  that  the  probability  is  y 
that  at  least  a specified  proportion  P of  the  distribution 
is  included  between  Lj  and  Lp.  The  limits  Lj  and  Lg  are 
called  tolerance  limits,  yis  called  the  confidence  coefficient. 

TWO-SIDED  TOLERANCE  LIMITS  FOR  NORMAL  DISTRIBUTIONS 


For  the  case  of  a normal  distribution  with  mean  /-K 
and  standard  deviation  o,  both  parameters  unknown,  Wald 
and  Wolfowitz  have  given  an  excellent  approximation  to  the 
problem  of  settinfj  two-sided  tolerance  limits  [14]. 

Let  X,  , Xp,  . , Xjj  be  a sample  of  N observations 

from  the  normal  distribution.  Let 


Define 


- 2:xi  2 

X = and  s 

N 


2'(xi  - x)^ 
N - 1 


A(x,  s,  X) 


1 


'“x  -.As  - i 

e 2 


X -As 


*Thls  work  was  supported  In  part  by  the  Oftlce  ot  Naval  Research. 
Reproduction  in  whole  or  In  part  is  permitted  tor  any  purpose  ot 
the  United  States  Government. 
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utilizing  this  approximation  A.  H. _Bowker  computed  extensive 
tables  of  factors  X such  that  x-Xs  and  x+Xs  are  two-sided 
tolerance  limits.  These  tables  are  given  in  [l]  . Bowker 

also  has  given  an  asymptotic  solution  to  this  case  of 
setting  two-sided  tolerance  limits  for  a normal  universe  . 


TWO-SIDED  TOLERANCE  LIMITS  FOR  THE  NORMAL  DISTRIBUTION 

USING  THE" SAMPLE  RANGE  OR  SAmiTTfVmGE'  TIAKGE 


Let  ^ be  a sample  estimate  of  a which  is  independent 
of  the  sample  mean  x,  and  such  that 


A(5?,  -K)  = -~ 


1 

■/2Tr 


X + 


1 

"2 


' a 


dt 


- 


is  a strictly  increasing  function  of  a.  Then  it  follows 
directly  from  the  arguments  of  Wald  and  Wolfowitz  cited 
in  Section  2 above,  that  an  approximation  to  the  value 
of  A such  that  Pr  fA(x,  u, A ) > P}  = 7 is  given  by 


I 
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where  is  such  that  Pr  = 1 - f , and  r is,  as 

before,  the  root  of  the  equation 


The  accuracy  of  the  approximation  is  the  same  regardless 
of  whether  the  sample  standard  deviation  s is  used  or 
whether  some  less  efficient  statistic  ^ is  used  in  place 
of  s.  The  effect  of  using  ^ instead  6f  s is  that,  on 
the  average,  somewhat  wider  tolerance  intervals  will 
result . 


Among  such  sample  estimates  of  a are  the  sample 
range  and  the  sample  average-range,  het  x'^/  denote  the 
largest  observation  in  the  sample  and  x^^)  the  smallest, 
then  the  sample  range  R = xv”)  - x'*^.  For  N = 2,  R 
and  s differ  only  by  a multiplicative  constant.  For 
N larger  than  10  the  efficiency  of  R as  compared  with  s 
decreases  rapidly.  It  is  customary  for  large  samples 
to  divide  the  sample  randomly  into  m equal  groups  of 
size  n and  to  compute  the  range  of  each  group.  The 
average  of  these  m ranges  is  called  the  sample  average- 
range.  We  shal?  denote  this  statistic  by  R_j  . The 
total  sample  size  N = mn.  For  m = 1 , Rj^  the  sample 

range,  R,  for  a single  sample  of  size  N ^ n.  For  con- 
ciseness in  the  subsequent  discussion  we  shall  refer  to 
both  the  sample  range  and  the  sample  average-range  as 

^,n* 

The  probability  integral  of  ^ from  a normal 
population  with  variance  , for  n ±“2,  J),  ...»  20,  has 
been  tabled  by  Pearson  and  Hartley  [^6].  For  m = 2,  3, 

. . . , 10,  and  for  n = the  probability  distribution  and 
percentage  points  of  have  been  computed  by  the 

writer  and  are  given  in’^Tj  . Fox  sample  sizes  which  are 
multiples  of  5>  ^ c is  used  extensively  in  industrial 
applications. 

THE  TABLES  OF  FACTORS  FOR  TOLERANCE  LIMITS  BASED 
ON  THE  RANGE  OR  AVERAGE-RANGE 

Factors  K such  that  x - KR]^  n ^ ^1  n 

two-sided  tolerance  limits  for  a ’normal  universe  are 
given  in  Table  1 for  n = 2,  J>,  ...,  10;  for  7’=  .75,  .90, 
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•95,  >975,  -99,  and  .995-  Values  of  P are  .75,  -90, 

•95,  .975,  .99,  -995,  and  .999- 

Factors  K such  that  x - and  x + KRjjj  j-  are  two- 

sided  tolerance  limits  for  a noriftal  universe  af’e  given  in 
Table  2 for  m = 2,  3,  10;  for  -75,  -90,  .95,  -975, 

.99,  and  .995.  Values  of  P are  .75,  .90,  .95,  -975,  -99, 
.995,  and  .999. 

The  factors  K used  in  Table  1 were  obtained  by  solving 
for  K in 


r 


where  is  such  that  Pr  > r3  = 7 • ’^^^6  values  of 

Ry  were^obtained  by  inverse  interpolation  in  the  Pearson 
and  Hartley  tables  for  n = 5,  - • • , 10.  ^or  n = 2 

the  values  of  R^r  were  obtained  from  tables  of  percentage 
points  of  the  distribution.  For  samples  of  size  2 the 
range  is  the  same  as  the  sample  standard  deviation,  except 
for  the  factor  v/5T 

The  factors  K used  in  Table  2 were  obtained  by  solving 
for  K in 


K 


where  Ry-  is  such  that  Pr[T^  =7-  The  values 

of  Ry  were  obtained  from  the ’tables  of  the  percentage 
points  of  the  distribution  of  the  average-range  for  sub- 
groups of  size  5,  computed  earlier  by  the  writer  [7] . 


The  values  of  r which  are  solutions  to  the  equation 


^ vir 


= P 


were  obtained  by  the  use  of  Newton's  Method  on  the 
equation  defining  r. 
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Examples  of  the  use  of  these  tables  follow  in  the  two 
subsequent  paragraphs . 

In  the  manufacture  of  electron  tubes  to  be  used  in 
stable  amplifiers  it  is  desired  to  know,  with  confidence 
coefficient  of  .99,  limits  within  which  90  percent  of  the 
future  tube  transconductances  lie.  The  required  tests  are 
made  on  8 tubes  and  the  transconductances , observed  in 
micromhos,  are  as  follows: 

4430 

4287 

4450 

4295 

4340 

4407 

4295 

4388 

4356 

From  Table  1,  the  value  of  K corresponding  to  n = 9> 
7*=  .99  and  P = . 90  is  1.290.  For  this  example,  x is 
found  to  be  4349.8  and  ff,  _ is  I63.  Thus  the  tolerance 
limits  are  given  by  4349.8^4  (I.29O)  (I63)  = [4139.53, 

4560.07] . 

In  studying  another  characteristic  of  the  vacuum 
tubes,  a sample  of  size  N = 20  was  taken.  The  sample  was 
grouped  into  4 subsamples  of  5 observations  each.  The 
ranges  of  each  of  the  4 subgroups  were  found  to  be 

36.02 

57.45 

56.95 

56.50 

The  average  x of  the  20  observations  was  given  as  448.50 
and  the  average  range  ^ is  computed  from  the  above  and 
found  to  be  36.68. 
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Assuming  t = .995  and  P = <90,  from  Table  2 we 
obtain  the  value  of  K = 1.285  corresponding  to  m =4. 
Thus  ^ he  tolerance  limits  are  given  by  448.50  + (1.283) 
(36.68)  = [401.44,  495.56]. 

After  the  present  tables  were  computed,  there 
appeared  in  the  March  1957  issue  of  the  Journal  of  the 
American  Statistical  Association  a set  of  tables  by 
S.  K.  Mitra,  under  the  title,  "Tables  for  Tolerance 
Limits  for  a Normal  Population  Based  on  Sample  Mean  and 
Range  or  Mean  Range". 

The  tables  included  herein  duplicate  some  of  the 
results  given  by  Mitra.  However,  it  was  decided  to 
proceed  with  the  publication  of  the  present  paper  for 
the  following  reasons: 

1)  The  present  tables  use  the  exact  distribution 
of  the  mean-range  in  their  construction  whereas  Mitra 's 
tables  compound  two  approximations.  In  particular  the 
expansion  used  by  Mitra  for  computing  the  percentage 
points  of  a X'^  variate  is  poor  for  small  values  of 
degrees  of  freedom,  especially  in  the  tails  of  the 
distribution.  As  a result  the  tolerance  factors  based 
on  an  average  range  statistic  from  m subgroups  of  5 
observations  each,  given  in  the  present  report,  will 
give  more  correct  results  than  will  Mitra 's  tables,  for 
m = 4,  5,  . . . , 10. 

2)  The  present  tables  include  tolerance  factors 
based  on  the  average-range  statistic  of  m groups  of  5 
observations  each,  for  the  useful  cases  of  ra  = 2 and 
3,  which  are  not  included  in  Mitra 's  tables. 

3)  The  present  tables  include  some  values  of 
confidence  coefficient  and  population  proportion  not 
included  in  Mitra 's  tables. 
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1.  'tolerance  Factors  for  Normal  Distributions  Utilizing 
the  Range 


Factcr'^.  " for  t.vo-sir’ed  tolerance  limits  such  that  the  probability 
is 'D'  that  at  lor.Gt  P of  the  distribution  "/ill  be  included  between 

X + '.’hero  % is  the  sample  range  for  a sample  of  size  n. 


'T  =.75  1 

n \ 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

3.181 

4.456 

5.243 

5.932 

6.739 

7.290 

8.429 

1.312 

1.857 

2.197 

2.498 

2.850 

3.092 

3.592 

h 

0.916 

1.301 

1.544 

1.759 

2.011 

2.185 

2.5'i5 

G,7U 

1.060 

1.259 

1.436 

1.645 

1.788 

2.087 

6 

0.547 

0.923 

1.097 

1.252 

1.435 

1.561 

1,823 

y 

0,584 

0.833 

0.992 

1.132 

1.299 

1.413 

1.652 

8 

0.540 

0.771 

0.917 

1.048 

1.202 

1.308 

1.530 

0.507 

0.723 

0.861 

0.984 

1.129 

1.229 

1.430 

1x0 

0.481 

0.687 

0.817 

0.934 

1.072 

1.168 

1 . 366 

"X  =.90 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

8.066 

11,298 

13.294 

15.043 

17.089 

18.486 

21.373 

3 

2,170 

3,071 

3.634 

4.130 

4.713 

5.113 

5.940 

h 

1,322 

1.878 

2.228 

2.538 

2.903 

3.154 

3.674 

5 

1.003 

1.428 

1.696 

1.935 

2,216 

2.409 

2.811 

6 

0.838 

1.194 

1.420 

1.620 

1.858 

2.021 

2.360 

7 

0.735 

1.049 

1.248 

1.425 

1.635 

1.779 

2.080 

0,666 

0,951 

1.132 

1.292 

1,483 

1.614 

1.888 

9 

0.615 

0,879 

1.046 

1.195 

1.372 

1.49^^ 

1.747 

10 

J 

0.577 

0.824 

0.981 

1.121 

1.287 

1.401 

i.64o 

1 
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Tr\blo  1.  TolarancG  Factors  for  Normal  Distributions  Utilizing 
the  Range  (continued) 


7 = . 95  1 

n 

• 75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

16.163 

22.641 

26.640 

30.145 

34.245 

37 . 045 

42.831 

3 

3.112 

4.403 

5.210 

5.922 

6.758 

7.331 

8.517 

4 

1.705 

2.423 

2.874 

3.274 

3.745 

4.068 

4.738 

5 

1.229 

1.749 

2.078 

2.370 

2.715 

2.952 

3.444 

6 

0.995 

1.418 

1.686 

1.924 

2.206 

2.400 

2.803 

7 

0.856 

1.221 

1.453 

1.659 

1.903 

2.071 

2.420 

8 

0.763 

1.090 

1.29^ 

1.481 

1.700 

1.850 

2.164 

9 

0.698 

0.997 

1.186 

1.355 

1.555 

1.694 

1.981 

10 

0.648 

0.926 

1.103 

1.260 

1.446 

1.575 

1.843 

Table  1 Tolerance  Factors  for  Normal  Distributions  Utilizing 
the  Range  (continued) 


r-.99 

n 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

80.867 

113.274 

133.283 

150.821 

171.332 

185.343 

214,292 

5 

7.059 

9.988 

11.820 

13.434 

15.331 

16.630 

19.320 

4 

2.982 

4.237 

5.026 

5.725 

6.549 

7.114 

8.287 

5 

1.903 

2.710 

3.219 

3.671 

4.205 

4.572 

5.334 

6 

1.^33 

2.042 

2.428 

2.771 

3.177 

3.456 

4.037 

7 

1.176 

o^ 

CO 

1 . 996 

2.279 

2.614 

2.845 

3.326 

8 

1.015 

1.449 

1.725 

1.970 

2.260 

2.460 

2.877 

9 

0.904 

1 . 290 

1.536 

1.755 

2.014 

2.193 

2.565 

10 

0.823 

1.176 

1.400 

1.600 

1.837 

2.000 

2.341 

'Jf"=.995 

fil 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

161.736 

226.552 

266.572 

301.648 

342.671 

370.693 

428.592 

5 

9-935 

14,058 

16.635 

18.907 

21.577 

23.405 

27.191 

4 

3.773 

5.361 

6 . 360 

7.244 

8.286 

9.002 

10.485 

2,276 

3.241 

3.850 

4.391 

5.029 

5.468 

6.380 

1.662 

2.369 

2.817 

3.215 

3.685 

4 . 009 

4.683 

7 

1.338 

1.910 

2.272 

2.594 

2.975 

3.238 

3. ■764 

8 

1 . 135 

1.620 

1.928 

2.202 

2.527 

2.751 

3.217 

1.003 

1.432 

1.704 

1 . 947 

2.235 

2 . 433 

2.847 

0.905 

1.292 

1.539 

1.758 

2.018 

2.198 

2.572 

77 


: ..... AM 


§ 


Table  2.  Tolerance  Factors  for  Normal  Distributions  Utilizing 
the  Average  Rp.nge 

Factors  K for  two-sided  tolerance  limits  such  that  the  prob- 
ability is  "Y  that_at  least  P of  the  distribution  will  be 
included  between  x + KRj^  where  Rjj^  ^ is  the  sample  average 
range  computed  on  the  basis  of  m subgroups  each  of  size  5- 


■1 

7 = .75 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

.638 

.911 

1.085 

1.240 

1.423 

1.550 

1.8l4 

3 

.602 

.860 

1.024 

1.171 

1.345 

1.465 

1.716 

4 

.582 

.832 

0.992 

1.134 

1.303 

1.419 

1.663 

5 

.570 

.816 

0.972 

1.111 

1.276 

1.391 

1.630 

6 

.562 

.803 

0.957 

1.095 

1.258 

1.371 

1.606 

7 

.556 

.794 

0.946 

1.082 

1.244 

1.355 

1.588 

8 

.551 

00 

0.938 

1.073 

1.233 

1.343 

1.575 

9 

.547 

.782 

0.932 

1.065 

1.224 

1.334 

1.564 

10 

.544 

.777 

0.926 

1.059 

1.217 

1.326 

1.555 

/ =.90 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

.772 

1.103 

1.313 

1.501 

1.723 

1.876 

2.196 

.699 

0.999 

1.190 

1.361 

1.563 

1.703 

1.994 

.662 

0.946 

1.127 

1.288 

1.480 

1.613 

1.889 

.638 

0.913 

1.087 

1.243 

1.428 

1.556 

1.823 

.622 

0.889 

1.060 

1.212 

1.392 

1.517 

1.778 

.610 

0.872 

1.039 

1.188 

1.365 

1.488 

1.744 

.601 

0.859 

1.023 

1.170 

1.345 

1.465 

1.717 

.593 

0.848 

1.010 

1.156 

1.328 

1.447 

1 . 696 

.587 

0.839 

1.000 

1.144 

1.314 

1.432 

1.679 
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Table  2.  Tolerance  Factors  for  Normal  Distributions  Utilizing 
the  Average  Range  (continued) 


Table  2.  Tolerance  Factors  for  Normal  Distributions 
Utilizing  the  Average  Range  (continued) 


'^=.99 

S.  p 
m 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

1.130 

1.614 

1.922 

2.196 

2.521 

2.745 

3.212 

3 

0.935 

1.336 

1.591 

1.819 

2.089 

2.276 

2.665 

4 

0.845 

1.205 

1.435 

1.641 

1.885 

2.054 

2.407 

5 

0.788 

1.127 

1.3^2 

1.535 

1.763 

1.921 

2.252 

6 

0.752 

1.0^5 

1.280 

1.464 

1.682 

1.833 

2.148 

7 

0.725 

1.037 

1 . 235 

1.413 

1.623 

1.769 

2.073 

8 

0.705 

1.0C8 

1.201 

1.373 

1.578 

1.720 

2.016 

9 

0.689 

0.985 

1.173 

1.3^2 

1.5^2 

1.680 

1.969 

10 

0.675 

0. 966 

1.151 

1.316 

1.512 

1.648 

1.932 

7'  = -995 

.75 

.90 

.95 

.975 

.99 

.995 

.999 

2 

1.252 

1.788 

2.129 

2.432 

2.792 

3.041 

3.558 

3 

1.009 

1.442 

1.718 

1.964 

2.256 

2.457 

2.878 

4 

0.897 

1.283 

1.528 

1.747 

2.007 

2.187 

2.562 

5 

0.832 

1.191 

1.417 

1.621 

1.862 

2.029 

2.378 

6 

0.789 

1.127 

1.343 

1.536 

1.765 

1.923 

2.254 

7 

0.758 

1.083 

1.291 

1 . 476 

1.696 

1.848 

2.166 

8 

0.734 

1.049 

1.250 

1.430 

1.643 

1.790 

2.098 

9 

0.715 

1.023 

1.219 

1.394 

1.601 

1.745 

2.045 

10 

0.700 

1.001 

1.192 

1.364 

1.567 

1.708 

2.001 
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ON  THE  CHOICE  OF  SAMPLING  INSPECTION  PLANS 


f 


By  Donald  Gnthi ie 


This  paper  summarizes  a Joint  research  effort  of  my- 
self and  Dr.  M.  Vernon  Johns  of  Stanford  University.  The 
primary  objective  is  basic  research  in  sampling  inspection 
schemes,  but  the  method  would  be  quite  easily  applicable, 
were  the  correct  data  available. 

Suppose  that  we  are  presented  with  a lot  consisting 
of  N items,  of  which  an  unknown,  nxanber  D are  defective. 

On  the  basis  of  observing  d of  tnese  defectives  in  a 
sample  of  n we  wish  to  decide  whether  to  accept  or  reject 
the  uninspected  remainder  of  the  lot.  There  are  two 
problems,  then,  choosing  the  sample  size  n,  and  the 
acceptance  number  a. 

The  "classical”  method  of  attacking  such  a problem 
is  to  choose  an  AQL  or  an  AOQL  or  some  similar  index  and 
consult  the  tabulated  sampling  plans  to  find  a plan  which 
matches  these  specifications.  What  we  propose  to  do  is  to 
use  cost  considerations  rather  than  AQL  or  AOQL  to  find 
the  best  n and  a. 

Actually  it  seems  tnat  cost  considerations  are  often 
used  in  choosing  an  AQL  but  they  are  used  subjectively, 
whereas  we  propose  to  use  cost  considerations  objectively 
wherever  possible.  There  will  be  cases  arising  in 
practice  where  the  classical  criteria  will  be  more  suitable, 
but  this  is  a choice  which  must  be  made  by  the  person 
choosing  the  plan  at  the  outset. 

Now,  we  adopt  the  following  cost  structure: 

c^  = Cost  of  accepting  a defective  item 

Cg  = Cost  of  inspecting  an  item,  that  is,  the  time, 
etc.,  required  to  determine  whether  the  item 
is  defective  or  good. 

c,  = Additional  Inspection  cost  if  the  item  is 
^ found  defective  for  example,  the  cost  of 

replacing  an  item  found  defective  with  a good 
item. 

Cj^  = cost  of  rejecting  an  item. 
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There  are  two  possible  decisions  which  may  be  made 
at  the  conclusion  of  the  sampling  inspection,  acceptance 
or  rejection  of  the  remainder  of  the  lot.  If  we  were  to 
accept  the  lot  we  would  incur  a cost  of  ci  for  each  of  the 
D-d  defective  items  left  in  the  lot,  but  if  we  were  to 
reject  the  lot  we  would  incur  a cost  of  c^  for  each  of  the 

N - n uninspected  items  remaining  in  the  lot.  Including 

the  sampling  cost,  we  may  summarize  the  total  cost  by  the 
following  table: 

Decision Cost 

Accept  Cj^  (D  - d)  + Cg  n + c^d 

Reject  c^^  (N  - n)  + Cg  n + c^d 

Now  suppose  that  we  know  the  true  value  of  p (we  never  do, 
of  course).  Then  the  expected  costs  would  be  as  follows: 

Decision Expected  Cost 


Accept  c^p(N  - n)  + C2n  + c^np 

Reject  C2^(N  - n)  + C2n  + c^np 

If  we  really  knew  p,  we  would  minimize  the  expected  cost 
by  accepting  whenever  p^Cu/c-^  and  rejecting  whenever 
p y C2,/c,  . This  then  defines‘*'an  "acceptable  quality  level" 
in  the  sense  that  p ^ desirable  and  p>ci./c  is 

undesirable  under  the  above  cost  structure.  ^ 

We  make  the  further  assumption  that  p varies  from  lot 
to  lot.  In  this  context  p is  not  the  proportion  of 
defectives  in  the  lot,  but  rather  the  probability  that  the 
machine  which  produces  the  items  will  produce  any  one  item 
defectively,  therefore  is  never  actually  observable.  The 
variation  of  p from  lot  to  lot  is  assumed  to  follow  a 
known  probability  distribution  F(p).  That  is,  within  each 
lot  the  probability  an  item  is  produced  defectively  is  a 
constant,  but  between  lots  p is  determined  by  independent 
observations  on  a population  with  cummulative  distribution 
function  F(p). 

This  situation  could  arise,  for  example,  if  different 
lots  were  produced  on  different  days.  It  would  be  reasonable 
to  suppose  that  p would  change  from  day  to  day,  and  the 
nature  of  this  variation  may  be  described  by  F(p). 
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Under  this  assoaptlon,  we  may  define  a risk  or  total 
expected  cost,  with  expectations  taken  from  lot  to  lot 
as  well  as  within  lots.  If  we  define 


(d) 


if  the  lot  is  accepted 
if  the  lot  is  rejected, 


then  the  total  expected  cost  is 
Rjj(n)  = ^(Cgn  + c^d  + Cj^f(d) 


(D  - d)  + Ci^(l  - /(d))  (N  - n)) 


Some  simple  algebraic  calculations  lead  to  showing  at  this 
point  that  the  best  /(d)  (the  one  which  minimizes  R»(n)  for 
fixed  n)  is 


{ 


E(pid)  ^ cj^/c 
E(p|d)  > 


where  E(p|d)  represents  the  conditional  expected  value  of 
(with  respect  to  the  distribution  F(p))  given  that  d 
defectives  have  been  observed  in  a sample  of  n.  Now, 
clearly  E(pld)  is  an  increasing  function  of  d so  we  may 
equivalently  express  (d)  by 


P 


d < [b(n)] 
d > [b(n}J 


where  b(n)  is  determined  by  solving  E(p|b(n))  = Cu/c  , 

That  is,  we  accept  whenever  d < and  reject^whenever 

d > [(b(  n)]  . In  the  more  involved  mathematical  parts  of 
this  paper,  we  have  derived  asymptotic  expressions  for  b(n) 
and  have  used  this  in  calculating  the  best  sample  size 
n(N)  as  a function  of  the  lot  size. 


There  are  two  cases  considered;  (l)  F(p)  has  a 
density  which  is  continuously  differentiable  at  C2|/c,, 
and  (2)  F(p)  has  probability  on  only  two  points, ^one  on 
each  side  of  Ci^^/c^.  The  results  are  as  follows: 


Case  Best  acceptance  n\unber 

1 b(n)  = (ci^/Cj^)  n+c+o(l) 

2 b(n)  = k^+kjn-ro(l) 


best  sample  size 
n(N)  = AN-'-^'^  + o(N^^'‘^) 
n(N)  = BlogN  + o(logN) 


I 

I 
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The  numbers  c,  k.,  A,  and  B all  depend  on  the  various 
costs  and  the  nature'‘'of  F(p).  The  symbol  o(g(N)}  indicates 
that  that  quantity  goes  to  zero  if  divided  by  g(N)  as 
N<^ao.  Similarly  o(l)  means  that  that  term  goes  to  zero 
as  n oe . 

In  conclusion,  there  are  two  possible  gerneralizatlons 
of  the  problem  which  should  be  exposed.  The  first  and  most 
Important  is  that  an  item  may  be  classified  by  a value  of 
a random  variable  X associated  with  it.  In  the  case  just 
considered  X takes  on  the  values  zero  or  one  depending  on 
whether  the  item  is  good  or  defective.  In  more  general  cases 
X may  be  the  number  of  defects  per  item  or  the  amount  by 
which  a dimension  differs  from  some  nominal  dimension.  The 
solution  given  above  carries  over  to  a fairly  wide  class 
of  distributions  including  most  of  those  found  in  practice, 
e.g.,  Poisson,  geometric,  chi-square,  etc.  That  is,  if  X 
is  a random  variable  with  one  of  these  distributions, 
then  the  optimal  sample  size  is  proportional  to  the  square 
root  or  the  logarithm  of  the  lot  size,  depending  on  which 
type  of  lot  to  lot  distribution  of  the  parameter  is  assumed 
to  exist. 

A second  generalization  concerns  only  the  case  where 
each  item  is  defective  or  good.  We  might  decide  that  there 
should  be  a cost  for  rejecting  items  only  if  they  are  good. 
That  is  Cj,  might  be  replaced  by  ci^’,  the  cost  of  rejecting 
a good  item,  and  there  would  be  no  cost  attached  to  re- 
jecting a defective.  This  would  change  the  total  cost  of 
a decision  to  the  following: 

Decision  Cost 

Accept  Cj(D  - d)  + C2n  + c^d 

Reject  ci^'  [(K  - D)  - (a  - d)]  . c,n  . c,d 

By  application  of  the  same  analysis  we  determine  that  the 
optimal  sample  size  is  still  proportional  to  the  square 
root  or  logarithm  of  the  lot  size  and  the  rejection 
number  is  proportional  to  the  sample  size,  although  the 
constants  are  different. 
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C.  Derman,^  S.  Littauer^’^  and  H.  Solomon^'^ 

Columbia  University 

1.  Introduction.  Industrial  needs  have  provoked  some  recent 
studies  on  continuous  sampling.  This  procedure  is  especially 
of  interest  when  the  formation  of  inspection  lots  for  lot-by~lot 
acceptance  nay  be  impractical  or  artificial  as  in  conveyor-line 
production,  or  when  there  is  an  important  need  for  rectifying 
quality  of  product  as  it  is  manufactured. 

These  newer  papers  are  best  considered  in  the  light  of 
the  earlier  papers  of  Dodge  (3)  and  Wald  and  Wolfowitz  (11). 

One  point  of  departure  from  the  Dodge  type  of  plan  has  been 
the  introduction  of  several  levels  of  partial  Inspection 
with  different  rates  of  sampling  in  each  level.  Multi-level 
continuous  sampling  plans  (which  reduce  to  the  Dodge  plan 
when  only  one  sampling  level  is  tolerated)  have  been  considered 
by  Greenwood  (8),  Lieberman  and  Solomon  (9)»  and  Resnikoff  (lO). 

A plan  based  on  the  Wald-Wolf owitz  approach,  a scheme  essentially 
handled  by  the  methodology  of  sequential  analysis,  was  created 
and  developed  by  Girshick  about  19^8  in  connection  with  a Cen.sus 
Bureau  problem  and  has  only  recently  been  reported  (7).  The 
reader  is  referred  to  Bowker  (1)  for  a more  thorough  account 
of  continuous  sampling  plans. 

The  multi-level  plan  given  in  (9)»  namely  MLP,  allov/s  for 
any  number  of  sampling  levels,  sub.iect  to  the  provision  that 
transitions  can 'only  occur  between  adjacent  levels.  Throe 
generalizations  of  HLP,  accomplished  by  altering  the  manner 
in  which  transition  can  occur,  are  analyzed  in  this  paper. 

In  each  situation,  we  will  make  it  more  difficult  to  get  to 
infrequent  inspection  than  in  HLP,  and  thus  wo  can  label  these 
throe  plans  as  tightened  plans.  These  three  plans  which  will 
now  bo  specifically  defined  obviously  relate  to  more  realistic 
situations  for  control  of  industrial  processes.  The  three 
plans  are  given  in  language  which  assumes  some  familiarity 
with  'iLP,  which  is  given  in  detail  in  (9). 
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(a)  The  MLP-r  x_l  Plan.  V/e  say  we  are  in  the  jth  sampling 
level  if  every  (l/f)J-th  item  produced  is  systematically  sampled. 

If  i consecutively  inspected  items  are  found  clear  of  defects 
when  sampling  at  the  jth  level,  begin  sampling  at  the  (j  + l)-th 
level.  On  the  other  hand,  if  a defective  item  is  found  before 
this  is  accomplished,  revert  immediately  to  the  (j  - r)-th 
level,  if  j > r,  or  to  the  zero  level,  that  is,  one  hundred 
percent  inspection  if  j r.  Let  inspection  begin  at  the  zero 
leVel.  When  r = 1,  we  have  the  MLP  plan  described  in  (9). 

(b)  The  RILP-T  Plan.  This  is  exactly  the  same  as  the 
MLP-r  X 1 Plan,  except  that  when  a defective  is  encountered, 
wa  immediately  revert  to  one  hundred  percent  inspection.  This 

5.S  obviously  the  tightest  of  the  throe  multi-level  plans  con-  i 

sidered  in  this  paper  and  thus  bears  the  label  MLP-T.  I 

i 

(c)  The  ilLP-r  x s Plan.  This  plan  follows  exactly  the 
"same  pattern  as  the  MLP-r  x 1,  except  that  when  i consecutively 
inspected  items  are  found  nondefective  while  on  the  jth  sampling 
level,  systematic  sampling  begins  at  level  (j  + s).  We  shall 
consider  the  case  r >•  s,  since  we  are  concerned  only  with 
tightened  multi-level  plans.  If  r = s,  we  are  effectively 
using  the  MLP  Plan. 


2.  Summary.  Each  of  these  generalizations  can  be  appraised 
under  the  assumption  of  an  infinite  number  of  sampling  levels 
or  a finite  number,  k,  of  sampling  levels.  Under  the  assump- 
tion of  an  infinite  number  of  allowable  sampling  levels,  it 
is  possible  to  obtain  explicit  relationships  between  the  AOQL 
and  the  parameters  of  the  plan  for  IiILP-r  x 1 and  MLP-T.  Thus 
it  is  possible  to  graph  contours  of  equal  AOQL  for  each  of 
these  plans  under  these  conditions.  Approximations  for  con- 
tours of  equal  AOQL  for  the  MLP-r  x s Plan  are  then  easily 
obtained.  This  makes  feasible  the  possibility  of  a catalogue 
of  continuous  sampling  plans  which  contains  plans  having  a 
prescribed  AOQL  and  thus  aids  immeasurably  in  the  choice  of 
an  appropriate  plan.  As  is  demonstrated  in  the  next  sections, 
the  following  results  are  obtained,  assuming  that  the  production 
process  is  in  statistical  control  and  items  found  defective 
on  inspection  are  replaced  with  good  items.  For  the  MLP-r  x 1 
Plan: 


(2.1) 


AOQL 


_ /f  - f^+-\ 

(l 


1/i 


L L 


86 


When  r = 1,  this  reduces  to  the  result  previously  obtained 
in  (9).  For  the  MLP-T  Plan: 

(2.2)  AOQL  = 1 - 

This  result  can  also  be  obtained  heuristically  by  letting  r 
approach  infinity  in  MLP-r  x 1.  For  the  MLP-r  x s Plan  (r>s) 
bounds  and  sometimes  exact  AOQL's  can  be  obtained  using  the 
previous  two  results.  For  example,  if  r = 4 and  s =-.2  and 
f is  given,  the  MLP-2  x 1 Plan  for  f*  = f2  will  be  the  same 
plan  and  hence  have  the  same  AOQL.  More  generally  for  a 
given  f we  can  write 


(2.3)  AOQLj...  xs  < A0QLj.3jg  < AOQLj. . 


where  r*  = greatest  nvimber  less  than  r that  is  a multiple 
of  s,  and  r"  is  the  smallest  number  greater  than  r that  is 
a multiple  of  s.  For,  if  r'<r”,  the  plan  associated  with 
r”  is  tighter  and  the  added  protection  thus  insures  a better 
outgoing  quality,  i.e.,  a smaller  AOQL.  Under  the  assumption 
of  a finite  number,  k,  of  allowable  sampling  levels,  the  AOQ 
function  for  MLP-T  is  obtained,  and  it  is  seen  that  the  use 
of  digital  computers  may  be  expedient  for  the  computation 
of  AOQL  contours.  This  was  exactly  the  situation,  for  finite 
levels,  in  (9).  The  main  results  of  the  paper  are  obtained 
through  the  use  of  Markov  chain  techniques  which  are  developed 
in  Section  3.  In  these  plans  inspection,  as  described,  is  by 
systematic  sampling.  However,  the  AOQ  and  AOQL  results  also 
hold  when  inspection  in  each  level  is  accomplished  by  random 
sampling  — i.e.,  in  the  ktli  level,  each  item  in  the  block  of 
f"*^  items  has  probability  f^  of  being  chosen  for  inspection. 


3.  Markov  Chain  Result.  Let  (n  = 0,  1,  ...)  denote 

an  irreducible  recurrent  positive  Markov  chain  with  states 
{Ej]  (j  = 0,  1,  ...).  Let  (Pij}  (i,  j = 0,  1,  ...)  denote 
the  probability  of  transition  from  state  Ej^  to  Ej . It  is 
known  (see  (5))»  that  a unique  sequence  |’v^  exists  such  that 


Z V 
i=0 


iPij 


(J  = 0,  1,  ...), 


(3.1)  VI  > 0, 


(i  = 0,  1,  ...), 


« 1 . 


I 


1 


I 


The  Vj^'s  are  sometimes  referred  to  as  ’’steady  state”  proba- 
bilities. 

Now  let  A = be  a subset  of  the  states.  Let  Yq^  Y^,... 

be  successive  members  of  which  take  on  values  in  A.  Since 

the  chain  is  recurrent,  infinitely  many  such  Y’s  will  exist 
with  probability  one.  It  was  shown  by  Derman  (2)  that 
(k  = 0,  1,  . . . ) is  also  a Markov  chain;  and  if 

transition  probabilities,  then 


the  solutions 

Vj  of 

E^fA  ^ 

= v’i 

(EjfA), 

(3.2) 

v’i  > 

0 

(Ei^A), 

2 v!  = 
E^fA  ^ 

1 

are  given  by 

(3.3) 

v’  = 

V. 

1 

(Ei£A). 

i 2 

Ej€A 

Suppose  Ai  = (j  = 1,  2,  . . . ) ; Ag  = fSjj  (j  = 2,  3,  • • •)5 

•••*g  * (®j)  <■!  * ® + 1 ,...).. . are  subsets  to  be  con- 

sidered. Let  ^Yjf(g)j  denote  the  Markov  chain  defined  over  Ag. 
Also  let  Ej(g)  (j  = 0,  1,  ...)»  tbe  states  for  the  chain 
{Yk(g)j»  be  a relabeling  of  the  states  Ej5(k  = g,  . . . ) by 
letting  .1  = k — g.  Finally  let  Pij(g)  denote  the  proba- 
bility of  transition  from  state  Ej(g)  to  state  Ej(g)  in 
the  chain  ^Yit(g)|  . Our  main  tool  is  the  following  theorem 
THEOREM.  If  Pij  = pij(g)  (i,j  =0,...  ; g = 1,...),  then 

(5-^)  Vj  = vo(l  -'Vo)J  (j  = 1,...). 
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PROOF.  Let  fvj(g)]  denote  the  solution  of  (3.1)  tor 
the  chain  (Yj5(g)J  . Since  the  transition  probabilities, 
by  hypothesis,  are  the  same  regardless  of  which  chain  is 
under  consideration,  Vi(g)  » vi  (i  = 0,  1,  ...).  However, 
from  (3.3)  we  have 


(3.5) 


^0  = '^0^®)  = 


G 


g 


2 V, 

j=»g  - 


g-1 

J=0 


1-  Z V 
1=0  J 


Thus  by  induction, 


^0(1  -^0  - •••  — Vj.i) 


(g  = 1,2,...), 


(3.6) 


( J — 1 , • • • ) , 


and  the  theorem  is  proved. 

We  shall  apply  the  theorem  in  the  following  case.  Suppose 

(i  = 0,1,  ...), 


Pl,i+1  >0 
Pi,0  “ ^ 

Pl,i_r  = 1 —t< 


(i  “ 0,1,  ...,r), 
(i>r). 


It  is  clear  that  the  chain  is  Irreducible.  It  also  follows 
from  a slightly  modified  theorem  of  Foster  ((6),  Theorem  5,  p.  8l ) 
that  the  chain  is  recurrent  positive  if'«C<r/(r  + l). 

Intuitively  this  condition  guarantees  a sufficient  pull  to 
the  left,  thereby  insuring  the  existence  of  the  steady-state 
probabilities  Inherent  in  a recurrent  positive  chain.  Further- 
more, it  is  easily  seen  that  the  conditions  of  the  theorem 
are  satisfied  so  that  the  v^  have  the  form  (3.^)*  From 
(3-1),  J = determined  by  the  following  equation 


(3.7) 


(1  -•><.) 


/l  ~ (1  — Vo) 

I ''0 


r+1 


= 1, 


and  thus  any  Vj  can  be  obtained. 
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' 4.  Application  to  MLP-r  x 1 infinite-level  plan.  The 

multilevel  plans  can  now  be  studied  from  the  point  of  viev/ 
of  a Markov  chain  and  the  results  in  Section  3 

employed.  We  let  = 0,  1,  . . . ; m = 0,  ...,  i - 1) 

denote  the  state  of  such  a chain  where  we  say  that  Xj^  is 
in  state  if  just  after  the  nth  item  has  been  inspected, 
the  process  is  in  the  jth  sampling  level  (i.e.,  every 

(f’’'^)th  item  inspected)  and  m nondefectives  have  been 
observed  successively  while  in  the  jth  level.  Suppose 
the  process  is  in  a state  of  control  such  that  p is  the 
probability  of  a defective  being  produced.  The  transition 
probabilities  are  then  given  by 

P(Ejm  Ej,m+l)  = ^ ^ P = «! 

(j  = 0,  1,  . . . ; m = 0,  1, ... ,i  — 2) 


(4.1)  P(Ej,i-.i-^Ej+i,o)  = 


P(E, 


q 

P 

EqO ) = P 


(j  — 0,  1,  ...), 

(.1  = r,  . . . ), 

( j “ ^ > • • • > r— 1 ) , 


The  chain  is  easily  seen  to  be  irreducible.  From  Foster's 
theorem  it  is  seen  to  be  recurrent  positive  if  < r/(r  + l). 

We  shall  assume  < r/(r  + l)  for  the  present.  Now  let 
A = {E-jqI  be  a subset  of  the  states  and  let  denote  the 

chair  defined  over  it.  The  chain  is  of  the  form  of  the 
special  case  considered  in  section  3 with  ot  = qi.  Let 
^v^l  and  ^Vj^j  denote  the  steady-state  probabilities  of  the 

chains  {Yjjj  and  [Xn|  , respectively.  Using  (3.1),  (3.5) 
and  (4.1)  it  follows  that 

(4.2)  Vjm  = I ILq  V'  q"*  (m  = 0,  1,  . . . , i - 1;  j = 0,1,..  . ), 
1 — J 


For  from  (3.1) 


.m 


'^jm  = '^jO^ 

(m  = 0,  ...,1  ~1;  j = 0,1,...), 
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and  jui’om  (3-5) 


Hence , 


jr  — 
’ 1 


'"jO 


k=0 


(j  — 0»  !>•••)• 


(j  — 0,  1,...); 


but  summing  over  j and  m we  get,  since  2^  mVj_  = 1, 

.1  > *•*  j 


2 V 

k=0 


kO 


From  (4.2)  it  is  clear  that  is  the  sum  of  the  steady-state 
probabilities  of  being  in  the  jth  level  of  sampling.  Also 
from  (3.4) 

(4.3)  (1  - vJ))-5  (j»l,  2,...', 

where  Vq  is  given  ’03'  (3-7)  'with  ec=  qi;  namely, 

(1  -aMp  - (1  j-  1, 

where  as  prsi’iously  remarked,  x^q  is  the  probability  of 
being  In  one  hundred  percent  inspection. 

Now  that  v/e  have  expressions  for  the  steady-state 
probabilities,  we  proceed  with  the  derivation  of  the  AOQ 
functions  and  the  AOQL.  Let  h(Xj^)  = f“J  for 

It  is  easily  verified  that  the  reciprocal  of  the  average 
fraction  inspected  after  n inspections  is 

(4.4)  F-1  =12  h(X^). 

n v=l 


1 
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It  follows  from  the  Birkhoff  ergodic  theorem,  applicable 
for  stationary  Markov  chains  of  the  type  considered  here 
(see  Doob  (l),  p.  460),  that 


(4.5) 


?-l  = 


= lim  F"^  = ± f-J 


n-^oo 


n 


J=0 


i-1 

2 V 

ra=0 


jm- 


Now  F~^  denotes  the  reciprocal  of  the  average  fraction 
inspected  for  all  sequences  (except  for  a set  having 

probability  0);  for  let  tj^  h(3Qn)  = number  of  items 

produced  during  the  first  k inspections.  Formula  (4.5) 
says  that  k/tj^— ►F  as  k — ► o®  . Let  tj^  ^ t < 

Then  since  k = number  of  items  inspected  in  the  first 
t items  produced,  the  inequalities 


k < k 


‘'k+1 


imply  that  limj^_^^  k/t  — >F  with  probability  1. 

If  q^  ^r/(r  + 1),  it  can  be  shovm  more  directly 
that  F~1  =‘»with  probability  1.  If  Vq  exists  and 

is  positive,  it  follows  from  the  theory  of  recurrent 
Markov  chains  that  q^  < r/(r  + 1).  Thus  since  0<rf<l, 
we  have  from  (4.2),  (4.5),  (4.5)  and  the  last  remark  that 


(4.6) 


F~^  = V ' 


CO . 


1 — 


1-  V^ 


v/hen  (f>l  — V(^), 


otherwise . 


Hence  since  it  can  easily  be  shown  that  AOQ  *p(l  - F),  we 
have 


(4 


AOQ  - (1  -q)^l^f...j 

\ / V/^ 


1 — q, 


» when  (f  > 1 —y^), 
otherwise . 
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Now  suppose  it  is  true  that  the  AOQ  is  an  increasing 
fiinctiou  of  q as  long  as  f>l  “ Then  fron  (4,7)  it 

would  follow  that 


(4.8) 


aool  = 1 - ao, 


where  qQ  is  the  value  of  q such  that  f = 1 — Vq.  From 
(3.7)  v/ith  oC  = qi , it  is  easily  established  that 


so  that 


(4.9) 


AQ^L  = 1- 


f ^ ^ 1/ 1 

1 _ yr+l  / 


We  nov/  sho"/  that  the  AOQ  is  an  increasing  function  ox 
q as  long  as 


q < 


^r+l  \ 1/ i 


(i.a.  , f > 1 — vA} 


<?^(q)  = 


“frV) 


AOQ  = (1  - q) 


■(q)  = l.I-JlA  . 


Then 


(4.10) 


-7(q)  + (1-q)  ^^(ai 

dq  ‘^q 


It  is  necessary  to  show  that  the  right-hand  side  of  (4.10) 
is  positive  or 


(4.11) 


v(q) 
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But,  using  (3.7)  withc3<  = qi, 
(4.12)  ^ 


/ \ 

\ '’0  / j + 1)(1-  VqK-^^  -qijlr 

/^<-v  ^-P  /)l  T *1  \ / 


Thus  the  left  side  of  (4.11)  becomes 

(4.13)  ~ q^)  + 1)(1  - Vo)^'*'^(l  - qi)  — (1—  )j 

iq^~^(l  - q) 

From  (3.7)  it  follows  that  (l  - = [(l  — VQ')-q^/(l-  qi ) 

Hence  (4.13)  becomes 


(^ 


.14)  - a (j.r.  <iM  r (1  - v) 

1 ^1-  q ; [_  ,1 


_ (r  + 1) 


']■ 


But  from  (3-7) 
q 


i = (i_  v5)  i_- ■ 

1-  (1-  v^)r+l  = 1 - V.  . 


'0 


Hence 


(1  - V’ ). 

3 = r , 


and  the  smallest  value  over  the  range  f>l  — Vq  which  the 

bracket  factor  in  (4.l4)  can  take  is  minus  one.  Thus  the 
largest  value  that  (4.l4)  can  reach  is 


(4.15) 


But 


‘rt^  ’ (?) 


Hf(i) 

This  proves  (4,11). 


q + + 


+ q^ 


<1 
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5.  The  MLP-T  Plan.  lYe  consider  first  an  infinite  number 
of  sampling  levels.  Let  E.jj^  be  as  in  the  previous  section 
The  transition  probabilities  are  no'v 

(j  = 0,  1,  . . . ; 0<m  < i - 2), 
P(Ej  ^ = q (j  = 0,  1,  ...)> 

i - 1 all  j,  ra). 

Of  course,  0 ■<  q.  < 1. 

It  can  be  shov/n  in  this  case  that 

''jm  * 


(j  — 0,  1,  •••!  El  — 0,...,  i — 1), 


and  as  before  that 


F-l  = z 
jm 


= oO 


= 1—  q^ 


1-  i 


AOQ  = - q)  qf  (. 

l-q^  V 


1 - f 


= 1 — q vt  " 

It  can  easily  be  shown  that  AOQ  is  an  increasing 

of  q for  0 <q^<  f . 


(f  ^ qM; 


(f  >qM, 

(f  = qi). 

ing  functi 


Hence 


AOQL  = 1 - f^ 


1 


Now  let  the  number  of  sampling  levels,  k,  be  finite.  For 
this  case  we  need  only  modify  the  function  h(Xjj)  such  that 


h(X^)  = f-j 
= f-k 


when  X„  = 
when  X„  = E.^ 


(j^  k), 
(J  > k), 


where  here  we  persist  with  the  notation  E.  as  if  the  k = oo 

jm 

plans  are  in  effect.  In  similar  fashion  we  have 


F“1  = p 


k-1  i-1 


i-1 


Z 2 + p 2 2 f-kqji+® 

j=0  m=0  j=k  m=0 


= (1-  qi) 

1 - q^/f 

For  k = 1,  v/e  have  the  Dodge  Plan,  and  get  the  following 
result  as  in  (5): 


,-l 


For  k = 2, 


f + q^(l  - f ) 


In  order  to  obtain  AOQL  contours  for  this  situation,  as 
for  higher  values  of  k,  the  use  of  digital  computers  would 
be  expedient. 
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TIME  AS  A RESPONSE 

By  G.  Stanley  Woodson 
Chief,  Biostatistics  Section 
Medical  Research  Directorate 
D,  S.  Army  Chemical  Warfare  Laboratories 


INTRODUCTION 

Time,  as  a response,  enters  into  many  investigations. 

It  may  appear  as  a part  of  the  treatment,  or  as  part  of 
the  response,  or  as  both  at  the  same  time.  On  other 
occasions,  when  time  is  measured  from  the  point  in  the 
proceedings  when  a treatment  is  applied,  interest  is 
centered  upon  the  length  of  time  until  a response  occurs. 

It  is  with  this  last  situation  that  we  shall  concern 
ourselves . 

There  arise  occasions  when  interest  is  centered  in 
describing,  over  the  complete  range  of  treatment  levels, 
the  time  of  occurrence  of  some  more  or  less  well  defined 
end-point;  the  time  to  rupture  of  metals  under  stress, 
the  latent  period  of  the  action  of  an  injected  drug,  the 
length  of  time  required  to  achieve  a certain  level  of 
activity,  or  almost  any  situation  where  we  have  need  to 
determine  the  speed  of  response.  In  general  it  has  been 
noted  that  the  functional  form  of  such  a relationship 
between  time  and  treatment  level  is  reasonably  well 
described  by  an  hyperbola.  In  some  cases,  however,  the 
hyperbolic  form  seems  to  hold  true  only  at  the  higher 
levels  of  treatment.  Here,  the  lower  level  treatments 
result  in  a decreasing  function  with  decreasing  level 
of  treatment.  This  sort  of  function  occurs  in  particular 
when  we  plot  the  mean  time  of  response  against  the  level 
of  treatment,  ignoring  the  non-responses. 

THE  PROBLEM 

During  experiments  at  the  Medical  Research  Directorate, 
U.  S.  Anny  Chemical  Warfare  Laboratories,  the  problem  arose 
of  describing  the  time  necessary  for  certain  agents  to 
have  an  effect.  This  problem  has,  of  course,  wide  practical 
application  in  chemical  warfare.  We  were  immediately  faced 
with  the  question  of  defining  an  expected  time  of  response 
in  a group  where  we  expect  only  a partial  response.  By  a 
partial  response,  I refer  to  the  case  where  only  a portion 
of  a given  group  reacts.  For  instance,  if  only  five  out 
of  a group  react,  just  what  do  we  mean  when  we  say  ’’mean 
reaction  time”? 
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Obviously  we  need  some  measure  which  will  not  only 
give  the  expected  response  in  terms  of  numbers  of  minutes 
or  hours,  but  one  that  will  also  tell  how  many  responses 
to  expect.  In  the  past  the  general  practice  has  been  to 
deal  with  the  reciprocal  of  the  time  (2,  3»  with  the 
viev:  in  mind  that  late  responses  would  carry  an  appropri- 
ately small  weight  and  each  non-response  could  be  in- 
cluded by  adding  nothing  to  the  total  and  adding  one  to 
the  number  by  which  the  total  is  divided  to  obtain  the 
mean  response  time.  Some  authors  have  utilized  this 
approach  and  ignored  the  resulting  small  bend  at  the 
lower  end  of  the  curve  (4,5).  This  approach  does  very 
nicely  if  we  only  desire  to  estimate  the  time  of  response, 
while  making  the  tacit  assumption  that  the  proportion 
responding  is  100  percent.  Since , for  our  purposes, we 
cannot  make  this  assumption,  another  approach  is  needed. 

THE  SOLUTION 


The  data  which  are  to  be  described  are  shown  in 
Figure  I.^  The  simplest  mathematical  model  which  presents 
itself  is  one  which  states  that  the  time  to  incapacitation 
is  inversely  proportional  to  the  dose  used.  That  is 

T = B/k  (1) 

where  T = time  to  response,  measured  from  the  instant 
the  treatment  has  been  applied. 

B = a constant  to  be  estimated 

k = dose 

It  is  immediately  apparent  that  equation  (l)  does  not 
present  the  true  picture,  for  as  dose  becomes  increasingly 
large,  equation  (l)  tells  us  tnat  T approaches  zero,  while 
the  data  approach  some  number  greater  than  zero.  That 
this  happens  is  not  too  surprising  in  this  case,  since, 
regardless  of  the  size  of  the  dose  administered,  a certain 
minimal  time  is  required  for  the  agent  to  penetrate  the 
tissues  and  start  to  have  an  effect.  Therefore,  consider 


^The  data  used  in  this  paper  have  been  transformed  in  such 
a manner  as  to  conceal  the  Identity  of  the  agent  used 
without  altering  any  of  the  statistical  properties  of  the 
data. 


the  following  modification  of  equation  (l): 


T = Tq  + (BVk)  (2) 

where  and  B'  are  constants  to  be  estimated. 

Equation  (2)  says  that  the  difference  between  this  minimal 
time  to  start  the  toxicological  process  and  the  actual 
time  to  response  is  what  is  to  be  considered  as  being 
inversely  proportional  to  the  dose. 

Now,  notice  that  the  times  to  respond  tend  to 
increase  with  decreasing  dose  until  a particular  area 
is  reached,  then  they  seep  to  stabilize.  This  would 
indicate  that  our  model  requires  further  modification. 

In  studying  time  responses  of  the  type  used  here,  it 
is  usually  noted  that  if  only  a partial  response  is 
obtained,  then  the  responses  that  are  noted  seem  to  occur 
at  fairly  early  times.  That  is,  if  a response  occurs 
in  connection  with  a low  level  treatment,  then  it 
generally  occurs  fairly  quickly.  It  would  seen  that  the 
weaker  animals  and  materials  respond  first,  the  stronger 
ones  either  hold  out  longer  or  do  not  show  a response  at 
all. 

You  will  notice  that  I stated  "if  only  a partial 
response  is  obtained...".  This  would  imply  that  the  time 
of  response  is  conditionally  dependent  upon  the  probability 
of  obtaining  a response.  This  seems  only  logical.  If  no 
response  occurs,  then  we  certainly  can't  measure  the  time 
of  response. 

A common  mathematical  expression  (used  in  probit 
analysis)  representing  the  proportion  affected  at  various 
dose  levels  is 

D + Kk 

P = (l/v^/e"*^/2dz 

— H 

where  P = expected  proportion  affected 

D and  E are  constants  to  be  estimated. 

Making  the  assumption  that  equation  {Z>)  actually  provides 
us  with  an  estimate  of  the  probability  of  the  occurrence  of 
a response  in  response  to  a dose  (k)  then  we  may  incorporate 
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equations  (2)  and  (3)  to  obtain  the  following  rather 
formidable  appearing  mathematical  model: 

D + Ek 
2 

T = [Tq  + (BVk)]  (l/v/?^)  /e~^  (4) 

-0<J 

This  model  gives  us  a predicted  response  time  which  is 
the  mean  expected  response  time  of  those  animals  that 
actually  respond.  Fitting  this  equation  to  the  data 
results  in  the  function  shown  in  Figure  2.  In  fitting 
this  function  to  the  data,  the  sum  of  squares  of  the 
differences  between  the  logarithms  (7)  was  minimized. 

This  sum  of  squares  was  considered  rather  than  the  sum 
of  the  squares  of  the  arithmetic  differences  because 
this  transform  resulted  in  a greater  degree  of 
homos cedasticlty  about  the  line. 

Thus  we  have  arrived  at  a solution  to  our  original 
problem,  which  was  to  describe  the  time  necessary  for  the 
agent  to  have  an  effect. 

THE  EXPANDED  PROBLEM 

In  order  to  put  our  solution  to  work  in  practical 
situations,  something  more  than  the  solution  found  here 
is  needed.  When  we  ask  such  a question  as  "if  I use  a 
dose  of  kj^ , how  long  will  it  be  before  25  percent  of 
the  exposed  group  react?  50  percent?  75  percent? 

95  percent?"  the  inadequacies  of  the  present  model 
become  apparent.  Such  information  simply  cannot  be 
obtained  from  it. 

Fortunately,  thanks  to  the  work  of  Shewhart  (8), 
Bowker  (1),  Wald  (9.  10,  11),  and  others  (6,  12,  13), 
a method  is  available  to  us  which  allows  us  to  make  some 
relatively  simple  adjustments  to  our  model  and  obtain 
the  sort  of  answers  we  need.  Consider  that  portion  of 
the  curve  where  a 100  percent  response  is  indicated. 

Here,  we  have  a series  of  observations  distributed 
around  a linear  regression,  and  it  is  a relatively  simple 
matter  to  define  ’tolerance'  limits  around  the  regression 
line  that  demarcate  upper  limits  for  any  desired 
proportion.  If  we  attempt  to  do  this  at  the  lower  levels 
of  treatment  we  run  into  difficulties,  for  here  we  are 
no  longer  talking  about  the  exposed  population,  but 
Instead  we  are  describing  only  the  responding  portion  of 
the  exposed  animals. 
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Referring  back  to  equation  (4),  if  we  select  a dose 
low  enough  to  affect  only  a portion  of  the  exposed  group, 
we  can  predict  the  proportion  expected  to  respond  at  that 
dose  as  well  as  the  mean  time  of  response  within  the 
responding  group.  If  we  now  define  tolerance  limits 
around  this  mean  time,  we  see  that  we  are  actually 
defining  some  unknown  proportion  of  the  total  exposed 
group.  It  is  a relatively  simple  matter  to  find  out  what 
this  proportion  is.  Let  us  choose  a dose  which  achieves 
a 30  percent  response  and  mark  off  a time  limit  by  which 
we  expect  75  percent  of  those  responding  to  have  responded. 
It  is  immediately  obvious  that  by  this  same  time  limit 
we  have  defined  a limit  such  that  75  percent  of  50  percent, 
or  37  1/2  percent  of  the  exposed  population  is  expected 
to  have  responded.  To  generalize  on  this,  we  may  say  that 
the  proportion  of  the  exposed  population  which  lies  below 
a particular  time  limit  is  described  by  the  product  of 
the  proportion  responding  and  the  proportion  of  those 
responding  which  lie  below  the  same  limit. 

THE  FINAL  SOLUTION 

Putting  all  these  ideas  together,  we  have  constructed 
a graph  (Figure  3)  giving  the  time  limits  by  which  a 
particular  portion  of  the  exposed  population  will  react 
over  the  whole  range  of  dose  levels  considered.  To  use 
this  graph,  we  select  some  dose,  say  3000,  and  read 
upwards.  We  note  that: 

10  percent  are  expected  to  respond  by  a time  of  13 

30  percent  are  expected  to  respond  by  a time  of  17 

50  percent  are  expected  to  respond  by  a time  of  20 

70  percent  are  expected  to  respond  by  a time  of  24 

90  percent  are  expected  to  respond  by  a time  of  32 

95  percent  are  expected  to  respond  by  a time  of  36 

99  percent  are  expected  to  respond  by  a time  of  47 

Notice  that  if  we  choose  a dose  at  which  a partial  response 
is  expected,  we  find  a slight  difference  in  reading  the 
graph.  Say  we  had  selected  a dose  of  500.  At  this  dose 
we  would  read  the  following: 

10  percent  are  expected  to  respond  by  a time  of  35 

30  percent  are  expected  to  respond  by  a time  of  45 
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but  we  cannot  find  a line  corresponding  to  50  percent  or 
to  any  proportion  higher  than  30  percent.  This  means  that 
we  do  not  expect  to  achieve  a response  rate  of  50  percent ; 
we  only  expect  a response  of  something  more  than  30  percent 
but  less  than  50  percent  at  this  particular  dose. 

SUMMARY 


Based  on  the  viewpoint  that  the  time  of  response  is 
conditionally  dependent  upon  the  probability  of  obtaining 
a response,  a relatively  simple  method  has  been  developed 
for  detennining  time  limits  by  which  a certain  proportion 
of  a population  exposed  to  a particular  treatment  is 
expected  to  respond.  A graph  has  been  constructed  and 
presented  which  allows  immediate  and  direct  determination 
of  these  limits. 
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LINEAR  STRUCTURAL  RELATIONSHIPS 
UNDERLYING  THE  DECOMPOSITION  OF  LEVINSTEIN  K 

By  Henry  Ellner 


As  the  title  of  this  paper  Indicates,  we  are  Boing  to  be 
concerned  with  statistical  and  chemical  relationships.  But 
unfortunately  there  are  very  few  of  us  who  are  well  versed 
with  the  principles  of  both  fields  so  that  we  can  readily 
comprehend  the  interplay  of  ideas  originating  from  the 
separate  disciplines.  If  you  can  bear  with  me,  either  as 
statisticians  or  as  chemists,  you  may  find  that  actually 
chemical  reactions  can  be  expressed  in  terras  of  statistical 
regression  equations  and  vice  versa. 

The  analogous  relationships  between  reaction  and  re- 
gression equations  contained  in  Exhibit  I on  page  51 > show 
chemical  reactions  depicting  the  decomposition  of  Levinstein 
process  mustard  gas  and  their  statistical  counterparts.  The 
regression  equations  were  developed  first;  the  chemical 
equations  followed  from  painstaking  efforts  to  explain  the 
structural  information  behind  the  regression  coefficients. 

By  structure,  I mean  the  functional  or  physical  connection 
behind  the  variates  represented  by  regression  equations. 

These  equations  are  not  limited  to  simple  linear  or  multiple 
regression  equations.  At  the  end  of  this  talk,  you  will 
find  a bibliography  pertaining  to  linear  relationships 
involving  instrumental  variates  and  variables  subject  to 
error.  These  relationships  estimate  the  true  connections 
between  the  interacting  variables,  but  as  we  shall  see,  the 
usual  regression  analyses  will  not  mislead  us. 

Since  we  are  going  to  depend  largely  on  reference  tables 
to  make  this  talk  clear,  it  would  be  well  for  us  to  become 
familiar  with  their  contents.  In  Table  I - Parts  A and  P, 
we  have  the  analytical  observations  obtained  on  52  samples 
of  Levinstein  H.  They  include  the  iron  content  of  the  sample 
as  ferrous  chloride,  the  purity  of  the  sample  as  obtained  by 
the  distillation  method,  the  freezing  point  of  the  sample 
and  the  acid  concentration  as  percent  hydrochloric  acid.  With 
the  exception  of  the  freezing  point  method,  all  tests  were 
performed  in  accordance  with  the  specification  standard  for 
Levinstein  H.  The  freezing  point  method  is  a rapid  test  for 
the  purity  of  Levinstein  H,  but  not  as  precise  or  accurate  as 
the  distillation  method.  The  observations  in  Part  A are  half 


of  the  total,  and  are  associated  with  the  lowest  26  sample 
ranked  by  their  iron  content.  The  remaining  half  of  the 
observations  are  in  Part  B associated  with  the  upper  26 
samples  ranked  by  their  iron  content. 


Table  I - Part  A 

Experimental  Results  of  Specification  Tests  on 
Levinstein  K Stored  in  Steel  Containers 

Iron  (%FeClp)  Purity  ij^)  Freezing  Point  (°C)  Acid  (%HC1 ) 


(f) 

(h) 

(z) 

(a) 

0.38 

69.09 

3.56 

0.60 

0.42 

67.77 

3.52 

0.79 

0.42 

67.31 

3.87 

1.43 

0.45 

67.42 

3.63 

1.29 

0.46 

69.12 

3.97 

0.75 

0.47 

71.76 

4.68 

0.4l 

0.51 

66.48 

3.29 

1.4o 

0.51 

68.89 

3.80 

0.83 

0.55 

68.69 

3.78 

0.96 

0.58 

65.48 

3.37 

1.34 

0.59 

68.86 

3.56 

1.13 

0. 66 

69.78 

4.18 

0.93 

0.81 

64.73 

3.12 

1.48 

0.85 

71.33 

4.85 

0.94 

0.90 

64.28 

2.25 

1.57 

0.90 

71.19 

4.98 

1.19 

0.94 

70.22 

4.14 

0.70 

0.96 

70.02 

5.10 

1.22 

1.09 

69.89 

4.07 

0.90 

1.09 

67.96 

4.18 

1.51 

1.12 

70.08 

4.44 

1.24 

1.22 

64.48 

3.15 

0.15 

1.23 

67.10 

4.4o 

1.47 

1.25 

63.40 

2.70 

1.84 

1.29 

65.98 

3.55 

1.52 

1.38 

64.48 

3.52 

1.29 

’)  = 0.8088 

xj(h)  = 67.9150 

Xi(z)=3.8331 

xi(a)=1.1108 
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Table  I - Part  B 


Experimental  Results  of  Specification  Tests  on 
Levinstein  H Stored  in  Steel  Containers 


Iron  ( FeCl^) 

Purity  ( H) 

Freezing  Point  (°C) 

Acid  ( HCl) 

(hj 

(a  j 

1.41 

64.62 

5.10 

1.49 

1.48 

64.84 

5.55 

1.49 

1.85 

62.22 

5.20 

2.24 

1.89 

64.51 

5.24 

1.97 

2.04 

67.65 

5.50 

1.95 

2.50 

64.74 

2.90 

1.51 

2.59 

58.44 

5.80 

1.20 

2.55 

65.54 

5.10 

2.52 

2.55 

61.02 

5.50 

2.81 

2.56 

64.22 

5.67 

1.62 

2.62 

61.45 

5.50 

2.56 

2.75 

58.28 

2.87 

5.01 

2.76 

65.57 

5.75 

1.48 

2.80 

55.04 

2.65 

2.08 

2.86 

60.57 

5.55 

0.96 

2.88 

61.88 

5.80 

1.52 

2.99 

60.76 

5.60 

1.64 

5.02 

59.48 

2.56 

1.69 

5.04 

56.45 

2.80 

0.17 

5.44 

59.68 

2.70 

1.26 

5.57 

59.62 

5.27 

1.80 

4.00 

54.80 

2.15 

1.^9 

4.07 

51.67 

1.72 

0.57 

4.29 

52.12 

2.85 

1.56 

6.28 

51.29 

2.00 

5.24 

6.40 

55.90 

-0.85 

5.62 

X2(f)=5.0288 

X2(h)=59.9208 

^2(z)=2.9025 

X2(a j=l .7955 

Next,  we  find  correlation  diagrams  which  show  plots  of 
the  data  of  Table  I.  The  upper  four  diagrams  illustrate  the 
scatter  of  values  for  pairs  of  variables.  The  S3mibols  used 
arc  identified  in  the  column  headings  of  Table  I.  The 
abscissas  of  the  two  lowest  correlation  diagrams  denote  the 
pure  mustard  gas  content  of  samples  as  predicted  from 
multiple  correlation  equations.  The  associated  observed 
mustard  content  of  the  samples  is  plotted  in  accordance  with 
scale  of  the  ordinate.  The  scatter  of  pairs  of  values,  the 
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predicted  and  the  observed,  reveals  the  degree  of  lack  of 
agreement . 


Table  II 


Correlation  and  Partial  Correlation  Coefficients 
for  Variables  Shown  in  Table  I 


■•hf . a=-0. 847»**rh, . ^>=-0.749*** 


rfaf =-0.880’^*'* 

'•ht.z=-0-7't3*** 

^hz=+0.760*' 

‘•hz.f-+0-'*005** 

rha=-0-^59**^ 

>^ha.z=-0-128 

rfa=+0-567*^* 

rfa.z^+0*  338* 

rfz=-0.712^**^ 

r =-0.510’*** 

-•az.h=-0-^9* 

“•hz . «88“''rh^ , ,.=+0. 4a8*  » 

^ha.f =-^0*1022  rha.zf =-^0.1951 

r,a.h=+0-386‘* 

“■fz . a=-0-  . ha=-0-  ^360 

’•az.l'-O-lS'*  ■■az.hf=-0.246 


3H-  Significant  at  least  on  the  5 percent  level 

jlUr  Significant  at  least  on  the  1 percent  level 
Significant  at  least  on  the  0.1  percent  level 


Table  II  presents  the  total  correlation  and  partial 
correlation  coefficients  for  the  four  variables  of  Table  I. 
The  first  column  on  the  left  contains  the  total  correlation 
coefficients,  each  showing  the  degree  of  association  on  a 
scale  ranging  from  zero  to  one  between  two  variables,  if 
the  negative  sign  is  ignored.  Then  looking  at  the  adjacent 
columns  from  left  to  right  we  notice  the  effect  on  the 
correlation  when  the  variables  shown  after  the  point  or 
stop  are  fixed  or  eliminated  statistically  from  interfering 
with  the  relation  of  the  two  variables  concerned.  The 
coefficients  in  columns  2,  ^ and  4 are  known  as  partial 
correlation  coefficients. 

Proceeding  to  Table  III  we  find  the  simple  linear  and 
multiple  regression  equations  which  are  going  to  be  the 
basis  for  this  talk.  The  last  two  equations  were  used  to 
predict  the  pure  mustard  content  of  Levinstein  H samples 
shown  in  the  lowest  two  correlation  diagrams.  The  equation 
depicting  h as  the  dependent  variable  and  and  as  the 
Independent  variables  is  portrayed  on  the  lower  left  and 
the  equation  depicting  h as  dependent  upon  Xf,  Xj.  and 


is  portrayed  on  the  lower  light  of  the  correlation  diagrams. 


The  multiple  correlation  coefficients  which  are  defined 
by  analogy  with  the  simple  correlation  coefficient  are  given 
adjacent  to  the  pertinent  multiple  regression  equation. 

They  are  used  as  a measure  of  the  strength  of  the  association 
of  h with  x’s. 


Table  III 

Simple  Linear  and  Multiple  Regression  Equations 
and  Coefficients  for  Variables  of  Table  I 


h 

70.36-3.36 

Xf  , 

r = 

-0.880 

= 

71.13-3.88 

Xf  , 

r = 

-0.875 

h 

ss 

69.94-3.48 

Xf+0.46  X , 

0.881 

h 

mS 

63.67-2.62 

Xf+1.57  Xj^, 

h(f3)  ■ 

0.900 

h 

= 

62.38-2.79 

Xj+1.70  X2+O.8I 

\ (fza) 

0.904 

^Observations  associated  with  and  including  the  two  highest 
ranking  iron  content  determinations  were  eliminated. 

Table  IV 

I 

Slims  of  Squares  and  Sums  of  Products 
of  Deviations  of  Variables  from  Their  Means 

From  data  of  Table  I: 


'2 

- 1506.5313 

Sx^^  = 103.4699 

_ '2 

Sx 

z 

t V 

= 44.9781 

Sx'^  = 25.2869 

3i 

Sx  x„ 
h f 

= -347.7282 

Sx’x'  =+197.8965 

ii  Z 

t f 

= -89.6539 

Sx^x^  = -48.5891 

= +28.9888 

Sx  X = -17.2160 

I 


Analysis  of  Variance  Table  V 


Source  of  Variation 

Sums  of 
Squares 

Degrees  of 
Freedom 

Mean 

Squares 

Variation  explained  by 

1168.61 

1 

1168.61 

Increment  explained  by  addition 

of  x„ 
a 

1.15 

1 

1.15 

Total  explained  by  x^^  and  xj 
together 

1169.76 

Residual 

336.77 

50 

6.7^ 

Total 

1506.53 

Analysis  of  Variance  Table  VI 


Source  of  Variation 

Sums  of 
Squares 

Degrees  of 
Freedom 

Mean 

Squares 

Variation  explained  by  x^ 

1168.61 

1 

1168.61 

Increment  explained  by 
addition  of  x^ 

53.40 

1 

53.40 

Total  explained  by  x^  and  x^ 
together 

1222.01 

Residual 

284.52 

50 

5.69 

Total 

1506.53 

Analysis  of  Variance  and  Co v'ar lance  Table  VII 
Within  and  Between  Groups  by  Wald's  Method 


Variance  of  x(f) 

S.  s. 

D.  f. 

M.  s. 

(IV)  Within  groups 

Ns*  = 39.40 

X 

N-2  = 50 

7.88 

( I ) Between  groups 

(n/4)(x2-Xj)^=  64.07 

1 

64.07 

Total 

Nsy  = 103.47 

N-1  = 51 

20.29 

Variance  of  y(h) 

S.  s. 

D.  f. 

M.  s. 

(VI)  Within  groups 

NSy  = 675.73 

N-2  = 50 

13.51 

(III)  Between  groups 

(N/4)(y2-y^)  - 830.81 

1 

830.81 

Total 

Ns  = 1506.54 

y 

N-1  = 51 

29.54 

Covariance 

S.  p. 

D.  f. 

M.VP 

(V) 

Within  groups 

NS^’y=  117.01 

N-2  = 50 

-2.34 

(II) 

Between  groups 

(N/4)(x2-Xi)(y2-yi)  = 

1 

-230.72 

- 230.72 

Total 

Ns  =-347.72 

xy 

N-1  = 51 

6.82 

b* 


^^.-2.31  1/b'  .^.33 


-230.72  _ , 


(39.40  _ llI^)/50  = 0.13814 

0.372  (error  in  Xj) 

675.73  - (117. 01^3.60)  /50  = 5.0899 
2.256  (error  in  y^^) 
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Table  IV  provides  the  statistician  with  derived  data 
for  calculating  the  regression  coefficients  of  the  simple 
linear  and  multiple  regression  equations  of  Table  III.  These 
data  also  serve  as  the  basis  for  the  two  Analysis  of  Variance 
Tables  V and  VI.  Statisticians  will  comprehend  the  use  of 
the  tables  and  the  chemists  will  do  best  to  skip  to  Exhibit 
I on  page  showing  the  analogous  relationships  between 
reaction  and  regression  equations. 

I am  not  so  sure  that  all  of  the  statisticians  will  be 
familiar  with  the  analysis  of  variance  and  covariance 
Table  VII  so  that  I shall  note  in  passing  that  they  consult 
E.  S.  Keeping's  paper  listed  in  the  selected  references. 

Exhibit  I contains  the  real  meat  of  this  paper.  Here 
we  have  postulated  chemical  reactions  and  stoichiometric 
relations  suggested  by  the  regression  equations.  From 
organic  and  physical  chemical  principles  and  research 
reported  in  the  literature,  the  reactions  postulated  seem 
likely. 

Now  I believe  we  are  ready  to  delve  into  the 
stoichiometric  relationships  and  structural  relationships 
underlying  the  deterioration  of  Levinstein  H under  normal 
storage.  Levinstein  H is  not  a pure  compound.  It  is  a very 
complex  mixture  containing  from  68  to  7-5  percent  pure 
mustard  and  the  balance  impurities  consisting  of  poly- 
sulfides which  degredate  in  time  to  precipitate  sulfur 
and  form  rearrangements  of  the  sulfur  atom  linkages. 

Pure  mustard  is  represented  by  the  formula 
CICH2CH2-S-CICH2CH2 . Replacement  of  the  single  sulfur 
atom  by'^two  or  more  sulfur  linkages  results  in  a polysulfide. 
The  polysulfide  believed  to  be  generally  present  in  the 
highest  concentration  in  newly  made  Levinstein  H is  repre- 
sented by  the  formula:  (ClCHgCH^ 

The  nature  of  polysulfides  has  been  ably  discussed  in 
a published  paper  by  Dr.  Macy  of  the  Chemical  Corps.  This 
paper  stated  that  the  remarkably  rapid  deterioration  of 
Levinstein  H in  small  steel  containers  under  tropical 
conditions  (100-150°  F)  is  thought  to  be  due  to  the 
oxidizing  nature  of  the  sulfur  in  the  polysulfides  upon  the 
iron  content  of  the  container.  This  reaction  sets  off  a 
chain  of  events  which  culminates  in  a substantial  loss  of 
pure  mustard  with  the  concomittant  formation  of  a tarry 
material  even  more  vesicant  than  the  original. 
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Exhibit  I 


f 

i 


I 


t 


Analogous  Relationships  Between  Reaction  and  Regression 

++  ••  B 

Fe  + S;  Fe  :S: 

• • •• 

CICH2CH2  - S - CH2CH2CI 

S=  ^ Fe'*"*'^— 

^ \CH2CH2-Cl 

CICH2CH2  - S - CH2CH2CI 

Simple  linear  regression  equation  (2  variables) 
h = 70.36  - 3.36Xj 

Wald's  structural  relation  (2  variables) 

h =v70.83  - 3.6OX, 


Stoichiometric  equivalent : 


3(CH2CH2C1)2S 


FeCl. 


3 •76%  change  in  pure  H O 1%  change  in  FeCl^. 


CICH2CH2  - S - CH2CH2CI 

^ I I 

Cl"-  Fe"*^-  Cl" 
CICH2CH2  - S - CH2CH2CI 


‘CH2CH^ 


Multiple  linear  regression  (3  variables) 

h = 63.67  - 2.62xj  + 1.57Xj 

Stoichiometric  equivalents; 

2{CR^CR^C1)^S  =0^  PeClg 


2.51%  change  in  pure  H sQr  1 % change  in  FeCl2. 

(C1CH2CH2)2S  O (CH2CH2)2S2 

1.327%  change  in  pure  H aQs  1 % change  in  p-dithiane. 


Equations 

(1) 

(2) 

(2a.) 

(2U) 

(2c^ 

(3) 

(3a.) 

(3b.) 

(3c^ 


I 

I 
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From  Raolt’s  Law  At  = 56.4  H for  pure  11 

changre  in  At  :(^  0.0275%  change  in  N 
and  1.585%  change  in  pure  H 1°C  change  in  At, 
where  At  = A£  , and  II  is  mole  fraction  of  impurity. 


CICIUCIL,  - S - QL 
2 ^ ^ 

Cl”  - Fe"^"^ 

t 

C1CH2CII2  - S - CH2CH2CI 


Cl  + S 


CII2CII2, 

Cn2CIl2'' 


Multiple  linear  regression  (4  variables) 
h = 62.58  - 2.79Xf  + 1.70xj  + O.BlXj^ 
Stoichiometric  equivalents: 

2.225(CI-l2CTl2Cl)2S  FeCl2.  since  J 


II.  ff.  (Cl 


= 0.225  (4b) 


2.79%  change  in  pure  H 1%  change  in  FeCl2 

(1. 225)0.777  (CIl2ai2Cl)2S  =Os  (CII^CH^  )2S2  (4c.) 

1.258^ change  in  pure  II  1%  change  in  p-dithiane. 

From  Raolt's  Lav/,  At  = 5^.4  N for  pure  I!, 

where  At  = A2  , and  N is  the  mole  fraction  of  impurity. 
1.67%  change  in  pure  H 1°C  change  in  2 

(0.225)(0.777)(CII2CH2C1)2S  =0=  HCL  (^^) 

. 755  % change  In  pure  H =<>  1%  change  in  HCL 
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If  we  now  refer  to  Exhibit  I we  can  follow  through  with 
the  postulated  series  of  reactions.  Equation  (l)  shows  the 
chemical  equation  leading  to  the  ferrous  ion  build-up  in  a 
Levinstein  H sample.  The  next  equation  assumes  that  ^ moles 
of  pure  mustard  react  with  the  ferrous  ions  to  obtain  an 
intermediate  coordinated  compound,  showing  dative  bonds 
between  three  sulfur  atoms  and  the  ferrous  ion.  Then 
equation  (5)  shows  the  decomposition  of  the  coordinated 
structure  to  form  the  chemical  compound  p-dithiane  and  the 
obelated  structure  with  two  moles  of  pure  mustard. 

Equation  (4)  is  similar  to  equation  (5)  but  one  chlorine 
atom  is  shown  outside  of  bracket  capable  of  ionizing.  This 
reaction  as  well  as  the  preceding  ones  is  somewhat  different 
from  the  mechanisms  proposed  by  chemists  who  worked  with 
pure  reagents.  Bell  and  his  co-workers  postulated  the 
formation  of  ethylene  chloride  as  well  as  p-dithlane,  and 
Fuson's  group  at  the  University  of  Illinois  substantiated 
this  finding.  But  both  research  groups  used  pure  mustard 
in  glass  vessals  which  were  heated  at  elevated  temperatures 
of  150°C  to  l80°C  from  18  to  48  hours . They  then  inferred 
that  a similar  reaction  occurred  at  the  so-called  "ordinary" 
temperature.  Fuson  also  arrived  at  a mechanism  for  the 
formation  of  the  tarry  decomposition  product  of  Levinstein  H. 
Again  his  group  heated  pure  mustard  and  found  condensation 
products  which  Fuson  thought  would  account  for  some  of  the 
highly  Insoluble  material  present  in  samples  of  heated 
mustard  gas. 

Apparently  then  the  postulated  series  of  equations 
must  be  substantiated  if  they  are  to  be  accepted.  The  proof, 
if  it  may  be  considered  such,  lies  in  the  data  of  Table  I, 
Parts  A and  B.  These  data  represent  a total  stock  of 
some  850,000  pounds  of  Levinstein  H,  accumulated  as  a 
result  of  World  War  II,  which  were  transferred  to  steel 
one-ton  containers  for  convenience  of  storage.  Nothing  is 
known  of  their  previous  history  except  that  at  one  time  the 
batches  of  mustard  met  the  specification  quality  standards. 

To  obtain  a record  of  the  current  quality,  a total  of 
52  samples  were  selected  at  random  and  subjected  to  the 
specification  tests  as  well  as  to  a freezing  point  test  used 
for  periodic  surveillance  of  the  stock.  The  data  are  shown 
ranked  in  accordance  with  the  ferrous  chloride  concentration 
of  each  sample.  This  order  was  found  useful  in  performing 
subsequent  statistical  analyses,  and. can  now  serve  to  orient 
non-statisticians  in  a casual  review  of  the  data. 


Li 
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The  correlation  diagrams  illustrate  the  connection 
between  the  variables  of  Table  I.  ITie  symbols  used  to 
denot  i the  variables  are  supposed  to  be  mnemonic  with  h 
for  pure  mustard,  a for  acidity,  z for  freezing  point  of 
the  mustard  and  f for  the  ferrous  chloride  concentration. 

But  if  one  is  not  careful,  one  may  think  that  f represents 
the  freezing  point.  The  letter  i is  reserved  by  statisticians 
for  denoting  an  individual  value  so  that  its  use  as  a sjnnbol 
for  iron  v/ould  be  confusing  to  them. 

Tlie  scatter  of  points  ma.y  confound  the  chtanist,  but  it 
is  a perfect  delight  to  the  statistician  who  can  now  ply 
his  trade.  And  we  can  see  how  foreboding  the  charts  are 
when  we  look  at  Table  II.  At  least  the  statisticians  will 
be  str’iick  by  the  highly  significant  correlations  which  are 
rendered  insignificant  when  the  secondary  variables  shown 
after  the  point  or  stop  are  fixed.  For  the  benefit  of 
the  chemists  as  well  as  the  statisticians,  I should  state 
that  these  symbols  are  in  accordance  with  the  v/ell-known 
text  of  Yule  and  Kendall. 

What  do  the  correlation  coefficients  tell  us?  For  one 
thing,  when  the  ferrous  ion  concentration  is  held  constant, 
we  can't  predict  the  mustard  content  from  knowledge  of  the 
acid  concentration.  Similarly,  the  ferrous  ion  concentration 
does  not  affect  the  depression  of  the  freezing  point  of 
Levinstein  H when  the  pure  mustard  content  and  the  acid 
concentration  are  held  constant.  These  are" weird  bits  of 
knowledge,  but  they  fit  into  the  mosaic  representing  the 
pattern  postulated  by  the  series  of  chemical  reactions 
appearing  in  the  reference  sheets.  All  of  the  correlation 
coefficients  derived  from  the  data  of  Table  I have  meaning 
to  the  experienced  observer. 

The  technical  importance  of  the  associated  variables 
is  shown  more  absolutely  by  the  appropriate  regression 
coefficients  of  the  simple  and  multiple  regression  equations 
shown  in  Table  III.  The  regression  coefficients  provide  the 
average  rate  of  change  of  the  dependent  variable  v,'ith  a unit 
change  in  the  independent  variable  or  variables.  If  the 
reality  of  these  coefficients  can  be  established,  we  are 
then  in  a strong  position  to  discuss  their  relation  with 
the  postulated  chemical  reactions. 
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The  existence  of  the  regression  coefficients  can  best  be 
aetermined  by  testing  for  their  significance  in  an  analysis  of 
variance  table.  The  two  analysis  of  variances  tables,  V and  VI, 
show  that  there  can  be  no  doubt  of  the  effect  of  the  ferrous 
chloride  concentration  upon  the  decomposition  of  the  pure  mustard 
content  of  Levinstein  H.  However,  the  acidity  of  the  sample  does 
not  appear  to  be  of  any  consequence.  With  respect  to  the  freezing 
point,  it  appears  to  be  a fair  indicator  of  the  purity  of  the  sample. 

Wien  the  prediction  equation  for  the  pure  H content  of 
Levinstein  mustard  Involved  four  variables,  another  approach 
which  can  be  comprehended  by  the  chemist  is  to  set  limits  of 
uncertainty,  that  is,  95  percent  confidence  limits  for  the 
regression  coefficients.  We  find  by  a modification  of  Fisher's 
that  these  limits  for  the  coefficients  of  the  equation, 
h=  62.38  - 2.79  Xf  + 1.70  + 0.81  Xa  are  the  following: 

-^.79  ± 0.71j  + 1.70  + 1.04  and  + O.8I  + I.18.  The  last  co- 
efficient includes  the  value  of  zero  and  is  therefore  deemed 
nonsignificant.  Again  the  ferrous  chloride  concentration  and 
the  freezing  point  determination  are  interrelated  with  the  de- 
composition of  Levinstein  H with  respect  to  its  purity. 

Since  it  cannot  be  presumed  that  the  ferrous  ions  react 
completely  with  the  pure  mustard  contained  in  Levinstein  H, 
we  need  another  statistical  method  to  give  the  best  quantita- 
tive estimate  of  the  functional  relationship  between  the  two 
reactants.  We  shall  use  the  simple  and  useful  method  of  Wald's, 
although  statisticians  may  want  to  apply  the  more  advanced 
procedures  cited  in  selected  references  included  in  the  reference 
sheets.  Wald's  method  has  recently  been  given  a thorough 
review  by  Kiefer  and  Wolfowitz,  but  Keeping  has  provided  a 
practical  approach  that  checks  the  assximptions  underlying 
Wald's  method.  This  procedure  is  set  out  in  the  Analysis  of 
Variance  and  Covariance  Table  VII.  The  analysis  yields  the 
sought-for  relation  between  the  pure  mustard  content  of 
Levinstein  H and  the  ferrous  ions  expressed  as  ferrous  chloride. 

A one  percent  increase  in  the  ferrous  chloride  concentration 
effects  a 3.60  percent  decrease  in  the  purity  of  Levinstein  H. 

We  also  have  estimates  of  the  errors  in  the  ferrous  ion  deter- 
mination and  the  analytical  procedure  for  determining  the  purity 
of  mustard.  These  errors,  which  Include  the  non-reactlve  por- 
tions of  the  variables,  have  been  stripped  from  observed  values 
to  provide  a valid  functional  relationship  between  the  reactants. 

Now  that  we  have  a good  quantitative  estimate  of  functional 
relationship  between  pure  mustard  and  the  ferrous  ions,  we  are 
ready  to  tackle  the  analogous  relationships  between  the  reaction 
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and  regression  equations.  Let  us  examine  the  reaction  equations 
and  the  regression  equations  side  by  side. 

The  stoichiometric  equivalent  given  by  (2a)  is  derived  from 
equation  (2).  The  3-76  percent  change  in  pure  mustard,  which  is 
equivalent  to  a 1 percent  change  in  ferrous  chloride  concentration, 
is  analogous  to  regression  coefficients  of  equations  (2a)  and 
(2b). 


Now  the  chemical  reaction  depicted  by  (3)  is  similarly 
analogous  to  regression  equation  (3a),  but  we  have  two  co- 
efficients to  consider.  From  the  stoichiometric  equivalent 
(3b)  we  find  that  the  change  in  pure  mustard  equivalent  to  a 
1 percent  change  in  ferrous  chloride  concentration  is  close 
to  the  coefficient  2.62.  Since  p-dithiane  was  not  determined 
analytically,  its  effect  is  observed  by  its  presence  as  an 
impurity  added  to  the  pure  mustard  content  of  Levinstein  11. 

The  freezing  point  is  thereby  affected  which,  in  turn,  indicates 
a drop  in  the  mustard  content.  It  all  resembles  a Rube  Goldberg 
cartoon  - but  the  entire  train  of  events  can  be  xollov/ed  through 
the  stoichio  ietric  equivalent  (3c)  and  the  a,pplication  of 
ilaoult’s  Law.  The  analogous  relationship  between  the  regresaion 
coefficient  of  1.57  and  the  change  in  pure  mustard  corres- 
ponding to  a one  degree  change  in  the  freezing  point  is  quite 
a,pparent . 

The  reaction  (4)  's  analo^'-ous  to  the  regression  equation 
(4a)  which  involves  four  variables.  To  demonstrate  this  re- 
lationship we  recall  that  (3)  showed  that  2 moles  of  pure 
mustard  combined  with  one  mole  of  ferrous  chloride,  FeCl2, 
and  that  one  mole  of  mustard  yielded  oiie  mole  of  p-dithiana, 
accounting  for  the  decomposition  of  three  moles  of  pure 
mustard.  The  problem  now  is  to  repartitjon  the  three  moles 
of  mustard  to  account  for  the  mn,gnitvide  of  each  of  the  three 
regression  coefficients  confronting  us  in  regression  equation 
(4a). 

Considering  that  portion  of  reaction  (4)  within  the 
square  brackets  we  obtain  the  stoichiometric  equivalent  (4b), 
which  states  that  2.223  moles  of  mustard  is  equivalent  to 
one  mole  of  ferrous  chloride.  The  aquivalenvCy  reflects  that 
one  mole  of  ferroiis  chloride,  FeCl2,  less  one  mole  of  chlorida 
ion  combines  with  two  moles  of  mtistard.  From  this  relation- 
ship we  readily  find  that  a 2.79  percent  decrease  in  pure  H 
concentration  is  manifested  by  a 1 percent  increase  in  the 
ferrovis  ion  concentration  reported  as  ferrous  chloride. 

As  we  have  accounted  for  2,223  moles  of  mustard,  there 
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remains  0.777  moles  to  be  partitioned  between  the  chloride 
ion  shown  outside  of  the  square  brackets  of  reaction  (4), 
and  the  p-dithiane.  The  presence  of  the  chloride  ion  is 


indicaced  by  hydrolysis  when  acidity  of  the  Levinstein  H 
sample  is  determined,  and  by  depression  of  the  sample’s 
freezing  point.  The  only  effect  of  p-dithiane  is  to  lower 
the  freezing  point  of  the  Levinstein  H.  Now  since  a total 
of  ^ moles  of  mustard  must  be  accounted  fox  as  a result  of 
reaction  (2)  the  following  partitioning  satisfies  the  combined 
effects : 

2.223+  [(1.223)  (0.777)]  - [(0.223)  (0.777  )]=  3. 000. 

The  quantity  within  the  square  brackets  on  the  far 
left  represents  the  moles  of  mustard  yielding  p-dithiane 
as  shown  by  (4c The  qviantity  within  the  square  brackets 
preceded  by  a negative  sign  represents  the  moles  of  mustard 
yielding  hydrochloric  acid  as  shown  by  (4d). 

The  derived  stoichiometric  equivalents  from  the  aboi^e 
partitioning  of  mustard  undergoing  decomposition  agree 
remarkably  well  with  the  corresponding  partial  regression 
coefficients  as  to  magnitude  and  sign.  Utilizing  Raoult's 
Law  we  derive  the  relation  tb'»t  a 1.67  percent  decrease  in 
pure  mustard  is  equivalent  to  a one  degree  Centigrade  de- 
crease in  the  freezing  point  of  the  crxide  mustard.  We  also 
obtain  the  relation  that  a 0.76  percent  inci-ease  in  pure 
mustard  corresponds  to  1.0  percent  increase  in  hydrochloric 
acid.  The  latter  seems  contradictory  to  observed  effects 
I but  reflection  will  disclose  that  the  apparent  increase  in 

pvirity  due  to  HCl  serves  to  counteract  the  excessive  decrease 
in  purity  represented  by  coefficients  associated  with  the 
iron  and  freezing  point  variables  of  equation  (4a).  When 
these  coefficients  are  compared  with  corresponding  coefficients 
of  multiple  regression  equation  (^a.)  it  will  be  noted  that 
the  latter  are  substantially  smaller. 

Unravelling  the  mechanism  underlying  the  decomposition 
of  Levinstein  H is  an  illustration  of  the  general  approach 
in  applying  regression,  functional  and  structural  relation- 
ships to  discover  scientific  laws.  In  the  field  of  chemistry, 
linear  structural  relationships  are  of  fundamental  importance 
in  that  chemical  elements  are  natural  building  blocks  which 
can  be  grouped  to  form  linear  structures.  Moreover  the  pro- 
perties of  molecular  compounds  are  usually  proportional  to 
their  concentration,  especially  xinder  cex'tain  restrictions. 
Consequently,  the  analysis  of  apparently  complex  relation- 
ships can  be  handled  quite  simply  by  applying  statistical 
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techniques  developed  for  the  special  purpose  of  detennining 
structural  or  functional  relationships.  In  the  special  case 
of  a decomposition  reaction  the  intermediate  stages  can  be 
revealed  by  noting  the  analogous  stoichiometric  equivalents 
and  the  corresponding  regression  coefficients  of  successive 
terms  of  simple  and  multiple  regression  equations. 


1 


♦ 


Selected  References  on  Determining  Structural 
or  Functional  Relationships 


I 


1 


( 

i 

E 

L 


► , 

I 


L 


A.  Wald,  "The  fitting  of  straight  lines  if  both  variables  are 
subject  to  error",  Ann.  Math.  Stat.,  Vol.  11  (19^0),  pp. 
284-500. 

D.  V.  Lindley,  "Regression  lines  and  the  linear  functional 

relationship",  Suppl . J.  Roy,  Stat.  Soc. , Vol.  9 (19^7)> 
pp.  218-244, 

R.  C.  Geary,  "Determination  of  linear  relations  between  syste- 
matic parts  of  variables  with  errors  of  observation  the 
variances  of  which  are  unknov/n",  Econometrica , Vol.  17 

(1949),  pp.  50-58. 

r.I.  S.  Bartlett,  "Fitting  a straight  line  when  both  variables  are 
subject  to  error".  Biometrics,  Vol.  5 (1949)>  PP.  207-212. 
Olav  Reirsdl,  "Identif lability  of  a linear  relation  betv/een 

variables  which  are  subject  to  error",  Econometrica,  Vol. 

18  (1950)  pp.  575-389. 

J.  W.  Tukey,  "Components  in  Regression",  Biometrics,  Vol.  7 

(1951),  pp.  53-69. 

M.  G.  Kendall,  "Regression,  structure  and  functional  relation- 
ship", Part  I,  Diometrika,  Vol.  58  (1951 )>  PP.  11-25. 

J.  Ileyraan  and  E.  L.  Scott,  "On  certain  methods  of  estimating 
linear  structural  relation  betv/een  two  variables",  Ann. 
Math.  Stat.,  Vol.  22  (1951),  PP-  352-361. 

M.  G.  Kendall,  "Regression,  structure  and  functional  relation- 
ship", Part  II,  Biometrika,  Vol.  59  (1952),  pp.  96-IO8. 

D.  V.  Lindley,  "Estimation  of  a functional  relationship", 

Biometrika,  Vol.  40  (1953),  PP*  47-49. 

C.  A.  Bennett  and  IT.  L.  Franklin,  Statistical  Analysis  in 

Chemistry  and  the  Chemical  Industry,  John  Wiley  5:  Sons, 
Inc.,  New  York  (1954),  pp.  465-469. 

J.  Wclfov/itz,  "Estimation  of  the  components  of  stochastic 
structures".  Proc.  Nat.  Acad.  Sci.,  J.S.A.,  Vol.  4o, 
llo.  7 (1954),  pp.  602-606. 

E.  3.  Keeping,  "I  cte  on  Wald’s  method  of  fitting  a straight 

line  when  both  v?.riables  are  subject  to  error".  Bio- 
metrics, Vol.  12  (1956),  pp.  445-448. 

J.  Kiefer  and  J.  Wolfowitz,  "Consistency  of  the  maximum  likeli- 
hood estimator  in  the  presence  of  infinitely  many  inci- 
dental parameters",  Ann.  Math.  Stat.,  Vol.  27  (1956), 
pp.  087-906. 

Selected  References  on  Levinstein  Mustard  Gas 

E.  V.  ?ell,  G.  M.  Bennett,  and  A.  L.  Ilock,  J.  Chtm.  Soc., 

Vcl.  151  (1927),  P.  1805. 

II.  SartOi'i,  The  War  Gases,  D.  Van  Nostrand,  New  York,  (1939). 

R.  C.  ?’--.3ra,  et  al , J.  Crg.  Chem.  , Vol.  11  (1946),  pp.  469-517. 
R.  Macy,  et  al,  "The  Polysulfides  in  Levinstein  Process  Mustard 
Gas",  Science,  Vol.  I06  (19^7),  PP.  355-359- 

i ia4 . 


Proceedings  of  the 
Third  Annual  Statistical 
Engineering  Symposium 


Submitted  by: 


Approved  By: 


U.  S.  Army  Chemical  Corps  Engineering  Command 
Army  Chemical  Center,  Maryland 


DISTRIBUTION 


1.  U.  S.  Amy  Chemical  Corps  Engineering  Command  distribution 
list  for  Statistical  Engineering  Publications  (l  copy 
each) 

2.  Symposivim  Attendance  List  (l  copy  each) 

3.  Office  of  Deputy  Chief  Chomical  Officer  for  Scientific 
Activities  (10  copies) 

4.  Director  of  Research  and  Development,  U.  S.  Amy  (4  copies) 

5.  Armed  Services  Technical  Information  Agency  (5  copies) 


